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SUMMARY 


Technical  Problem 

The  Network  Analysis  Corporation  contract  with  the  Advanced  Research 
Projects  Agency  incorporates  the  following  objectives:  To  determine 
the  most  economical  configurations  for  the  ARPA  Computer  Network; 
to  study  the  properties  of  store-and -forward  networks,  and  in  particul 
to  investigate  the  relationship  between  traffic,  routing,  throughput, 
and  cost  for  large  networks;  and  finally,  to  develop  procedures  for 
the  analysis  and  design  of  reliable  and  survivable  computer  and  com¬ 
munication  networks. 

General  Methodology 

The  study  of  ARPA  Net  design  properties  hac  heavily  used  the  NAC 
computer  network  design  programs  for  generating  low  cost  systems. 

*  The  approach  to  the  reliability  problem  has  combined  analysis,  com¬ 
binatorics  and  computer  simulation  to  derive  efficient  reliability 
analysis  schemes.  The  heart  of  the  research  program  has  been  a  dual 
attack  on  basic  network  theoretical,  problems  and  the  development  of 
computational  techniques  for  efficiently  handling  large  network 
structures. 

Technical  Results 

Some  of  the  results  accomplished  during  the  reporting  period  are: 

•  A  projected  26  node  design  is  shown  to  be  within  1%  of  a  theoretical 
globally  optimum  solution  and  a  projected  40  node  design  using  hypo¬ 
thetical  node  locations  indicates  that  the  economic  trends  exhibited 
by  the  previous  evolution  of  the  ARPA  Net  can  be  expected  to  continue. 

•  A  detailed  throughput  reliability  analysis  of  the  ARPA  Net  con¬ 
sidering  element  failures,  traffic  requirements,  routing,  and  accept¬ 
able  delays  shows  that  the  Network  is  highly  Cidaptable  to  component 
failures. 

•  It  is  shown  that  the  high  peak  bandwidths  presently  achievable 
within  the  Network  are  obtained  at  virtually  no  cost. 

•  A  new  routing  procedure  yielding  throughputs  extremely  close  to 
the  optimal  during  heavy  traffic  is  described.  This  new  algorithm 
represents  a  major  computational  breakthrough  for  the  "shortest 
path  problem, "  which  is  one  of  the  most  fundamental  of  network 
analysis. 

•  Major  computational  improvements  for  large  network  reliability 
analysis  are  described. 


Department  of  Defense  Implications 

The  new  technical  results  extend  our  previous  conclusions  about  the 
economic  viability  and  practicality  of  ARPA-like  networks  for  DOD 
communications.  The  results  on  reliability  increase  the  range  of 
networks  that  can  be  studied  to  include  very  large  networks  of  the 
kind  that  would  be  required  for  Defense  Communications.  The  new 
computational  results  on  routing,  shortest  paths,  and  connectivity 
will  increase  the  savings  resulting  from  optimization  of  these 
networks . 

Implications  for  Further  Research 

The  present  results  point  to  the  need  and  aid  in  the  progress  of 
research  in  a  number  of  areas  including:  determining  the  relation¬ 
ship  between  network  connectivity,  s ize/ reliability  and  survivability 
developing  new  optimization  algorithms  for  very  large  network  design; 
developing  design  procedures  for  large  networks  which  specifically 
incorporate  reliability/availability  requirements  as  constraints. 
Furthermore,  the  significant  computational  improvements  in  the  con¬ 
nectivity  and  shortest  path  algorithms  open  new  possibil  ities  for 
the  improved  optimization  of  other  network  structures  such  as  large 
scale  systems  of  Telpaks  and  other  leased  line  options. 
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DESIGN  PROBLEMS  FOR  COMPUTER  NETWORKS 


The  present  Network  Analysis  Corporation  contract  with  the 
Advanced  Research  Projects  Agency  incorporates  the  following 
objectives : 

•  To  determine  the  most  economical  configurations  for  the 
ARPA  Computer  Network. 

•  To  study  the  properties  of  stcre-and-forward  networks,  and 
in  particular  to  investigate  the  relationship  between  traffic, 
routing,  throughput,  and  cost. 

•  To  develop  procedures  for  the  analysis  and  design  of  reliable 
and  survivable  computer  and  communication  networks. 

The  research  effort  has  resulted  in  a  constantly  evolving  net¬ 
work  optimization  computer  program  which  is  able  to  produce  extremely 
economical  networks.  The  program's  capabilities  have  been  advanced 
c.o  the  point  where  networks  with  several  hundred  nodes  can  be  handled. 
Cost- throughput  characteristics  for  a  200-node  store-and- forward  net¬ 
work  were  determined.  These  characteristics  extend  the  results  of 
previous  studies  which  showed  that  large  ARPA-like  networks  are 
economical  to  operate  using  the  present  equipment  of  the  ARPA  Net. 

For  the  ARPA  Computer  Network,  low  cost  networks  have  been 
derived  and  augmented  as  the  network  has  grown.  It  has  been  shown 
that  the  ARPA  network  provides  near  optimal  performance  and  retains 
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its  high  throughput  capabilities  under  variations  in  input  traffic 
rates. 

Activity  in  the  reliability  and  survivability  areas  has  focused 
on  formulating  realistic  network  survivability  criteria  and  develop¬ 
ing  procedures  for  analyzing  and  designing  large  networks.  The 
effort  has  resulted  in  the  development  of  analysis  methods  more  than 
1000  times  more  efficient  than  conventional  schemes. 

Many  formidable  problems  remain  in  the  optimization  of  the  design 

of  computer  networks.  These  problems  which  are  under  study  at  NAC 
include: 

K  Ch°ice-  In  *ral,  there  are  [  :]  [ 

ways  of  arranging  M  links  among  N  nodes.  Considering  all  possible 
designs  by  computer  is  out  of  the  question,  and  no  known  theoretical 
method  exists  for  finding  an  optimal  computer-communication  layout. 

Discrete  Elements.  Components  usually  are  available  in  discrete 

sizes.  Thus,  line  speeds  can  be  at  2000,  2400,  3600,  ...,  9600 . 

->0,000,  240,000  baud,  etc.  This  means  an  integer  optimization  prob¬ 
lem  must  be  solved.  Except  in  special  cases,  no  theoretical  methods  • 
now  exist  for  problems  of  practical  size. 

Nonlineanties.  Component  coot  structures,  time  delays,  and 
reliabilities  are  all  nonlinear  functions.  Typical  cost  functions 
are  neither ' "concave"  nor  "convex"  and  no  analytical  method,  are 
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available  to  obtain  optimal  solutions  fci  networks  containing  such 
elements . 

Present  methods  for  topological  optimization  involve  the 
heuristic  application  of  a  family  of  optimization  procedures  called 
"branch  exchanges."  Branch  exchange  methods  are  search  procedures 
c'.nd  for  network  designs  incorporating  realistic  constraints  on 
routing,  throughput,  delay,  cost,  reliability  and  physical  imple¬ 
mentation,  the  complexity  of  the  computation  is  on  the  order  of  n3 
to  n6  where  n  is  the  number  of  nodes.  For  networks  with  several 
hundred  nodes,  present  procedures  are  inadequate  because  of  the 
large  amounts  of  computer  time  needed  to  perform  the  optimization. 
Therefore,  entirely  new  classes  of  optimization  techniques  must  be 

developed  for  large  scale  networks.  Research  on  these  new  procedures 
is  now  underway. 

Routing.  For  a  centralized  network,  the  routing  problem  reduces 
to  a  flow  control  problem  since  there  is  only  one  path  between  any 
pair  of  nodes.  On  the  ether  hand,  for  distributed  networks  like 
the  ARPA  network,  twe  different  kinds  of  routing  problems  must  be 
solved  to  specify  and  operate  an  efficient  network.  Routing  procedures 
used  for  design  must  be  effective  for  finding  low  cost  networks.! 
However,  once  a  particular  network  structure  has  been  selected,  it 
becomes  essential  to  take  full  advantage  of  the  location  and  capacity 
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of  each  line  and  node. 


Furthermore,  the  routing  procedures  installed 


in  the  physical  network  must  (1)  keep  network  "overhead"  low  and 
(2)  adjust  to  variations  in  traffic  as  a  function  of  time.  For  the 
design  problem  traffic  flows  are  usually  assumed  to  be  time  invariant 
A  variety  of  alternate  routing  procedures  which  can  be  rapidly  per¬ 
formed  by  computer  are  then  possible.  'These  procedures  must  model 
the  dynamic  routing  strategies  which  are  actually  implemented  in  the 
network.  Furthermore,  the  performance  of  a  particular  routing  strat¬ 
egy  is  critically  dependent  on  the  capacities  assigned  to  the  links. 
In  many  procedures  either  these  capacities  are  assigned  before  the 
routing  is  performed,  or  a  routing  is  first  performed  and  capacities 
then  assigned.  The  difficulty  with  such  approaches  is  that  a  £riori 
the  routing-capacity  assignment  combination  is  biased  and  often  any 
changes  of  effecting  economics  are  reduced.  Thus,  problems  of 
importance  are:  (1)  to  find  routing  procedures  which  are  realistic 
and  simultaneously  can  be  run  in  milliseconds  during  optimization 
routines,  and  (2)  that  no  general  procedures  are  yet  known  for  as¬ 
signing  capacities  from  a  wide  range  of  options  while  simultaneously 
optimizing  the  routing  used  in  the  design  procedure.  We  view  this 

as  one  of  the  most  important  open  problems. 

Clustering.  The  design  of  small  networks  (say,  less  than  100 

nodes)  is  relatively  straightforward.  However,  the  design  for 
larger  networks  is  under  intensive  study.  At  presept,  it  appears 


and  implementation  will 


that  the  most  fruitful  approach  to  design 
be  based  on  the  partitioning  of  the  network  into  regions,  or 
equivalently,  oonstructing  a  large  network  by  connecting  a  number 
of  regional  networks,  to  send  a  message,  a  sender  might  specify 
(1)  the  destination  region  and  (2)  the  destination  node  in  that 

region,  in  order  to  create  effective  partitions,  we  must  solve  a 
variety  of  "clustering"  problems. 


Nodes  may  be  clustered  into  regions  for  numerous  reasons  such 
as  (a)  to  partition  status  information  for  use  in  routing,  flow 
control,  and  other  decision  process  within  the  operating  network; 

(b)  to  determine  regions  of  low,  medium  and  high  speed  lines  in 
hierarchical  structures;  (c)  to  determine  decompositions  for  topologi¬ 
cal  designs,  and  (d>  to  find  concentrator/multiplexer  locations. 

The  literature  on  clustering  and  partitioning  is  large  but  frag¬ 
mented  and  spread  over  many  domains  including  information  retrieval, 
taxonomy  and  networks.  A  potentially  valuable  research  area  is 
the  application  of  known  clustering  techniques  to  computer  networks. 
This  requires  the  assignment  of  appropriate  "distance  measures"  to 
take  into  account  cost,  capacity,  traffic,  delay,  reliability  and 

routing.  Almost  no  theoretical  results  are  presently  known  for  this 
problem. 


Reliability.  An  essential  characteristic  of  any  good  network 
design  is  that  it  not  suffer  significant  degradation  in  performance 
if  some  elements  fail.  With  the  state  of  current  technology,  both 
nodes  and  communication  links  have  nontrivial  downtimes.  Therefore, 
the  network  design  must  provide  for  these  failures  by  having  suffi¬ 
cient  alternate  paths  to  satisfy  flow  requirements  and  time  delay 
constraints.  For  example,  some  networks  are  made  reliable  by  in¬ 
stalling  parallel  nodes  and  lines  while  the  Arpa  design  utilizes 
distributed  control  *nd  multiple  independent  paths  between  each 
pair  of  nodes. 

Tho  network  reliability  problem  has  two  aspects— analysis  and 
design.  Reliability  analysis,  even  for  large  nets,  has  now  been 
advanced  to  the  point  where  it  appears  relatively  straightforward. 
Preliminary  studies  indicate  that  for  large  networks,  reliability 
may  be  the  dominant  design  constraint.  However,  the  development 
of  design  techniques  which  handle  realistic  reliability  constraints 
is  still  in  its  infancy. 

In  this  report,  we  summarize  NAC's  studies  of  computer  network 
analysis  and  design  during  the  period  15  June  1971  to  15  December 
1971. 
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ARPA  Net  Studies 


Chapter  2  describes  NAC's  studies  of  the  economic  and  growth 
characteristics  of  the  ARPA  Network,  in  Section  2.1,  the  continued 
evolution  of  the  Network  is  discussed  and  it  is  seen  that  a  projected 
26  node  design  is  within  1%  of  the  theoretically  globally  optimum 
but  unrealizable  solution  that  would  exist  if  all  nodes  were  to  be 
connected  at  the  same  time  without  the  constraint  of  an  installation 
schedule.  Of  equal  importance,  a  projected  40  node  design  using 
hypothetical  node  locations  indicates  that  the  economic  trends  ex¬ 
hibited  by  the  previous  evolution  of  the  Net  can  be  expected  to 
continue. 

Section  2.2  provides  a  detailed  throughput  reliability  analysis 
of  the  ARPA  Net.  This  analysis  considers  element  failures,  traffic 
requirements,  routing,  and  acceptable  delays  as  well  as  other  per¬ 
tinent  network  characteristics.  This  study  shows  that  as  long  as  a 
pair  of  nodes  can  sustain  any  communication,  the  network  will  have 
sufficient  capacity  and  routing  algorithms  will  be  able  to  utilize 
this  capacity  to  attain  throughputs  near  the  ideal  design  levels 
achievable  under  failure  free  conditions. 

Section  2.3  considers  two  problems:  (i)  The  cost  of  providing  the 
peak  bandwidths  of  85  KBPS  per  node  pair  that  are  presently  realiz¬ 
able  in  thu  ARPA  Net;  and  (2)  The  incremental  costs  for  adding 


For  the  first  problem,  it  is 


"user  type"  nodes  to  the  ARPA  Net. 

shown  that  only  insignificant  savings  can  be  achieved  by  allowing 
major  reductions  in  the  ARPA  Net's  peak  bandwidth  capabilities. 

For  the  second  problem,  cost-performance  tradeoffs  for  adding  new 
network  nodes  are  established. 

Routiner 

The  objective  that  time  delay  be  minimized  subject  to  a  set 
of  flow  constraint;  makes  the  routing  problem  a  variation  of  a 
nonlinear  multicommodity  flow  problem.  This  problem,  which  was 
discussed  in  our  Second  Semiannual  Report,  can  be  readily  formulated 
as  a  separable  convex  programming  problem  with  the  delay  as  the 
objective  function  and  the  conservation  of  flow  and  capacity  limi¬ 
tations  as  the  constraints;  but  for  networks  with  more  than  a  few 
nodes  it  is  not  computationally  efficient  to  solve  the  programming 
problem,  and  this  approach  cannot  be  used  during  the  design  stage. 

A  heuristic  routing  procedure  (described  in  Semiannual  Reports 
1  and  2)  routes  flow  over  the  least  utilized  paths  containing  a 
minimum  number  of  nodes.  This  approach  yields  throughputs  within 
556-20%  of  optimum;  and  in  addition  to  being  fast  (over  three 
orders  of  magnitude  faster  than  the  programming  approach),  it 
facilitates  minor  changes  of  the  network  structure.  On  the  other 
hand,  it  does  not  take  good  advantage  of  possible  split  routing 

. 
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and  variations  in  link  capacities,  and  leaves  room  for  considerable 
improvements  especially  in  the  case  when  the  network  contains  a 
wide  distribution  of  different  line  capacities.  (An  apparently 
desirable  characteristic  of  very  large  networks.) 

A  generalization  of  the  above  routing  procedure  is  discussed 
m  detail  in  Section  3.2  of  Chapter  3.  Different  types  of  flows 
are  simultaneously  routed  over  the  paths  with  minimum  numbers  of 
nodes.  (These  paths  are  "shortest  paths"  using  a  simple  unit 
metric  for  each  line.)  When  no  shortest  path  with  excess  capacity 
is  available,  the  saturated  lines  are  deleted  from  the  network  and 
flows  are  then  routed  over  the  shortest  paths  of  the  remaining 
subnetwork.  The  process  is  continued  until  the  network  is  dis¬ 
connected.  The  new  procedure  yields  throughputs  extremely  close 
to  the  optimal  during  heavy  traffic.  Furthermore,  the -routing 
strategy  is  very  similar  to  physical  routing  schemes  under  study 
for  the  ARPA  Network,  and  it  exhibits  analogous  behaviorial 
properties . 

Equally  important,  the  new  routing  algorithm  represents  a 
major  computational  breakthrough  for  the  "shortest  path  problem." 

The  problem  is  one  of  the  most  fundamental  ones  of  network  analysis. 
New  algorithms  for  ihis  problem,  which  appear  to  be  the  most  effi¬ 
cient  yet  devised,  are  given  in  Section  3.3.  In  Section  3.4 
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the  computational  efficiency  of  the  new  algorithms  are  compared 
with  the  previously  accepted  "best"  algorithm. 

Reliability 

Due  to  the  success  and  economic  potential  of  the  "ARPA-like" 
networks,  the  size  of  computer  networks  can  be  expected  to  increase 
rapdily.  A  large  number  of  computers  in  a  computer  network  gives 
rise  to  several  questions  about  its  reliability.  For  the  ARPA  Net, 
the  principal  reliability  requirement  for  network  designs  of  less 
than  30  or  40  nodes  is  that  there  exist  two  node  disjoint  paths 
between  every  pair  of  nodes.  This  guarantees  that  at  least  two 
nodes  or  links  must  fail  before  any  two  nodes  cannot  communicate 
with  one  another.  Many  detailed  reliability  analyses  of  networks 
designed  in  this  way  indicated  that  this  approach  guarantees  suffi¬ 
cient  reliability  for  the  network  taken  as  a  whole  for  nets  similar 
to  the  current  ARPA  Net.  The  first  question  of  interest  is:  does 
the  two  node  disjoint  path  method  suffice  as  the  number  of  nodes 
grows?  closely  related  to  this  question  is:  what  minimum  amount  of 
network  investment  is  required,  as  the  number  of  nodes  increases, in 
order  to  maintain  a  given  level  of  network  reliability.  In  Section  4.2 
preliminary  results  bearing  on  these  questions  are  given.  Simply 
stated,  it  does  not  appear  that  network  reliability  constraints* 
can  be  met  for  very  large  nets  simply  by  requiring  two  node  dis¬ 
joint  paths  between  each  pair.  Mcbb  sophisticated  techniques  for 
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designing  large  nets  will  be  required.  Such  techniques  are  currently 
under  investigation. 

For  many  reasons  it  seems  imperative  that  large  computer  nets 
will  exhibit  some  hierarchical  or  decomposed  structure.  In  Section 
4.3  the  computational  consequences  for  reliability  analysis  of  a  two 
level  hierarchical  approach  is  investigated  in  which  the  nodes  are 
partitioned  into  subnetworks  called  "regions"  interconnected  by  a 
"global"  network.  In  the  same  section,  the  related  question  of  what 
size  regions  yields  minimum  computation  for  analysis  is  explored. 

Finally,  to  make  reliability  analysis  of  large  networks  feasible, 
computation ai  improvements  over  the  techniques  employed  for  the 
smaller  networks  must  be  developed.  A  detailed  analysis  of  the 
growth  of  computation  with  network  size  for  various  reliability 
analysis  techniques  is  found  in  Section  4.4,  and  new  techniques 
that  are  considsrably  faster  than  previously  known  techniques  are 
specified. 
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ARP A  NETWORK  ANALYSIS  AND  DE SIGN 


During  the  reporting  period,  a  number  of  optimizations  were 
performed  to  introduce  new  nodes  into  the  ARPA  net,  to  test  and 
improve  overall  network  economy  and  reliability,  and  to  study  the 
economic  and  growth  characteristics  of  the  ARPA  network.  The 
results  of  these  studies  are  summarized  in  the  following  sections. 

2.1  ARPA  NETWORK  GROWTH 

i 

Since  initially  there  was  no  clear  knowledge  of  the  total 
traffic  the  network  would  have  to  accommodate,  the  network  was 
first  constructed  with  enough  capacity  to  accommodate  any  reason¬ 
able  traffic  requirements.  At  the  initial  stages  of  the  design, 
the  "two-connected"  reliability  constraint  forced  the  network 
throughput  to  be  in  the  range  10-15  KBPS/node  since  two  communica¬ 
tion  paths  between  every  pair  of  IMPS  is  needed.  As  new  IMPS  are 
added  to  the  network,  the  capacity  is  being  systematically  reduced 
until  the  traffic  occupies  a  substantial  fraction  of  the  network's 
total  capacity.  At  this  point,  the  network's  capacity  will  be  in¬ 
creased  to  maintain  a  desired  percentage  of  loading.  To  insure 
that  this  process  can  be  efficiently  performed,  each  basic  configu 
ration  is  designed  so  that  additional  links  can  be  added  to 
economically  increase  network  throughput. 
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If  the  locations  of  all  network  nodes  are  known  in  advance, 
rt  is  clearly  most  efficient  to  design  the  topological  structure 
as  a  Single  global  effort.  However,  in  the  arpa  Net,  as  in  most 
actual  networks,  node  locations  are  added  and  modified  on 
numerous  occasions.  On  each  such  occasion,  the  topology  could  be 
completely  reoptimized  to  determine  a  new  set  of  link  locations. 


in  practice,  however,  there  is  a  long  lead  time  between  the 
ordering  and  the  delivery  of  a  link  and  major  topological  modifi¬ 
cations  cannot  be  made  without  substantial  difficulty.  It  is 
therefore  prudent  to  add  or  delete  nodes  with  as  little  disturbance 
as  possible  to  the  basic  network  structure  consistent  with  overall 
economic  operation.  Figure  2.1.2(a)  shows  the  26-node  ARPA  Net 
derived  using  the  policy  of  adding  new  nodes  with  minimum  disturb- 
the  basic  15-node  configuration  existing  in  March  1971  in 
the  least  costly  manner.  This  26-node  net  has  a  link  cost  of  ap¬ 
proximately  $880,000  per  year,  a  throughput  of  about  9.9  KBPS/node, 

an  average  availability  of  communication  paths  between  96%  of 
all  node  pairs. 


At  approximately  26  nodes  the  growth  pattern  within  the  net 
maxes  it  desirable  to  implement  some  fundamental  changes  in  netwbrk 
structure.  The  original  net  expanded  eastward  from  a  4-node  con¬ 
figuration  on  the  west  Coast.  Because  of  this  origination,  the 
west  coast  had  somewhat  more  capacity  than  other  parts  of  the 
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country.  Also,  because  of  the  excellent  relative  location  of  the 
UTAH  node,  two  of  the  three  planned  cross  country  paths  utilize- 
this  node  thus  creating  a  great  dependence  in  the  enlarged  net. 

Finally,  the  expanded  net  has  a  number  of  new  nodes  in  the 
Washington,  D.C.  area.  A  redesign  of  the  network  taking  advantage 
of  these  facts  is  shown  in  Figure  4.2.2(b).  The  new  network  design 
was  aimed  at  changing  as  few  existing  or  ordered  links  as  possible, 
maintaining  a  throughput  of  around  10  KBPS/node,  and  increasing 
network  reliability. 

The  new  network  design,  which  is  redrawn  for  visual  conven¬ 
ience  in  Figure  2  ,2.2  (c)  has  a  link  cost  of  $810,000  per  year 
($70,000  per  year  lower).  Significantly,  the  network  reliability 
has  also  been  increased  to  a  point  where  further  substantial  in¬ 
creases  can  be  made  only  by  either  adding  many  new  links  or  reducing 
IMP  downtimes.  A  graph  of  reliability  versus  element  downtime  is 
shown  in  Figure  2.1.2(d)  for  the  designs  in  (a)  and  (b) . 

To  test  the  overall  economy  of  the  design  shown  in  Figures  4.2.2(b) 
and  (c),  another  design  was  produced,  The  additional  design  was 
generated  under  the  assumption  that  all  26  nodes  were  to  be  inter¬ 
connected  into  a  network  at  the  same  time,  with  no  restrictions  ’on 
link  locations.  This  design,  which  represents  a"global"  optimization, 

~  s  3hown  in  Figure  4.2.2  (e) .  This  topology,  which  is  believed 
optimal  under  uniform  traffic  requirements,  has  link  costs  of  $800,000 
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Cost/Node 

(K$/Year) 


[VOLUTION  OF  LINE  COST  PER  NODE  FOR  ARPft 


TABLE  2.1.1 


Node 

Number 


NODE  COORDINATES 

OPERATIONAL  OR  PROPOSED  LOCATIONS 

„  .  „  Node  Location 

- Latitude  longitude 


1 

UCLA 

2 

SRI 

3 

UCSB 

4 

UTAH 

5 

RAND 

6 

BBN 

7 

SDC 

8 

MAC 

9 

ILLINOIS 

10 

HARVARD 

'  11 

CARNEGIE -MELLON 

12 

ETAC  (WASHINGTON) 

13 

SAAC 

14 

LINCOLN  LABS 

15 

CASE 

16 

STANFORD 

17 

MITRE 

18 

NCAR  DENVER 

19 

UCD 

20 

AFWS  OMAHA 

21 

ROME,  N. Y. 

22 

NASA 

23 

use 

24 

TINKER 

25 

MCCLELLAN 

26 

NBS 

27 

NEW  YORK 

28 

UCSD 

29 

ABERDEEN 

30 

FT.  BELVOIR 

Rank  Ancng 

Largest 

Cities 

HYPOTHETICAL  LOCATIONS 

31 

3 

CHICAGO 

32 

4 

PHILADELPHIA 

33 

5 

DETROIT 

34 

9 

ST.  LOUIS 

35 

14 

MINNEAPOLIS 

36 

15 

BUFFALO 

37 

16 

HOUSTON 

38 

17 

MILWAUKEE 

39 

19 

SEATTLE 

40 

20 

DALLAS 

34  04 

37  22 
34  30 
40  40 
34  00 
42  30 
34  01 
42  30 
40  05 
42  30 

40  30 

38  50 

38  55 

42  35 

41  30 

37  18 

39  00 
39  30 

38  39 
41  00 

43  15 

37  17 

34  00 

35  27 

38  35 

39  08 
41  15 
32  55 
38  60 
38  65 


47  49 
40  0 
42  22 
38  39 
44  58 

42  54 
29  46 

43  10 
47  36 
32  45 


118  31 
122  10 

119  45 
111  50 
118  35 

71  20 
118  33 
71  12 
88  30 
71  15 
79  50 
77  00 
77  10 
71  20 
81  45 
122  10 
77  00 
105  00 

121  45 

96  00 
75  25 

122  02 
118  21 

97  32 
121  30 

77  10 
73  47 
117  20 
77  0 
77  0 


87  37 
75  13 
83  10 
90  15 
93  15  1 
78  71 

95  21 
87  56 

122  20 

96  48 
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FIGURE  2.1.2(a) 

Unconstrained  26-Node  Net  Optimization 


Cost:  $800, 000/year 
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pair  AVn  i  Ihlbi  lj  ty  i  94.2% 


A  simple  and  natural  character^ ation  of  network  reliability 

15  th°  aWlity  °f  the  netWOrk  t0  Sustai"  communication  between  all 
operable  pairs  of  nodes.  For  design  purposes,  the  retirement  of 

two  independent  paths  between  nodes  insures  that  at  least  two  nodes 

and/or  links  must  fail  befure  am.  ■ 

befure  any  pair  of  operable  imps  cannot 

communicate.  This  • 

tenon  is  independent  of  the  properties 

of  the  nodes  and  links,  and  does  not  take  ini- 

ot  ta.ce  into  account  the  "degree" 

of  disruption  that  may  occur  -a.  ^ 

y  occur.  Hence,  it  does  not  reflect  the 

actual  availability  of  resources  in  the  net. 

A  more  refined  measure  is  the  average  fraction  of  node  pairs 
that  cannot  communicate  because  of  node  and  link  failures.  To 
calculate  this  measure,  knowledge  of  the  element  failure  rates 
must  be  available  or  estimated,  if  desired,  the  availability 
Of  specific  nodes  and  the  existence  of  specified  ccnunicating 
node  parrs  can  also  be  considered  using  this  formulation.  However 
the  ..expected  fraction  of  nonco^unicating  node  pairs-  is  still  a 

purely  topological  reliability  measure  which  does  not  completely 

reflect  the  "adequacy"  of  a  no+-ti«  t, 

y  a  network  operating  without  some  of  its 

components . 

*•  ““  detailed  level  °f  Of  reliability  incorpor¬ 

ates  element  failures,  flow  retirements,  routing,  acceptable  delays 


"*  other  pertinent  network  characteristics.  In  order  to  t„t 
the  adequacy  of  the  ARPA  Net  under  the  most  stringent  of  condi- 

trons.  a  reliability  analvsis  treating  these  fact 

ng  tnese  factors  was  performed. 

The  23-node  Arpa  Net  studied  in  detail  in  the  ibird  Seri- 
nnu.l  Report  was  considered  to  maintain  continuity  of  treatment. 

The  effect  on  throughput  at  average  delay  o  2  * 

ge  delay  0.2  seconds  was  examined 

by  removing  nodes  and  links  from  the  network  and  a  ,  ■ 

network  and  applying  the  NAC 

routing  and  analysis  algorithm  to  the  remaining  network.  To 
perform  a  total  analysis,  an  unmanagable  nurfcer  of  computations 
would  be  required.  Therefore,  throughputs  for  only  one  and  two 

node  failures  and  one  and  two  link  failure. 

nK  failures  were  calculated.  To 

-  conservative,  it  was  assumed  that  all  removals  of  three  com¬ 
ponents  or  more  would  reduce  throughput  to  zero.  That  is.  any 
combrnatron  of  hree  or  more  elements  was  assumed  to  be  a  cut. 

Since  there  are  many  such  combinations  which  are  not  cuts  (for 
example,  only  about  25*  of  the  possible  three  link  combinations 
are  cuts),  the  actual  average  network  throughput  is  slightly 
higher  than  the  numbers  given  below.  • 

Table  2.2.1  and  2.2.2  show  the  effects  of  link  and  node 
failures  on  network  throughput  under  the  assumption  that  all 
fic  requirements  are  equal.  The  nominal  throughput  of  the 
23  node  net  with  all  elements  operable  is  11.5  KBPS/node. 
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Table  2.2.1  shows  the  effect  for  link  failures  while  Table  2.2.2 
shows  the  effect  for  node  failures  for  element  downtimes  of  2%. 

(The  estimates  for  downtimes  in  the  operating  network}.  Table  2.2.3 
and  2.2.4  itemize  the  basic  data  summarized  in  the  first  two  tables. 
Combining  both  the  node  and  link  failure  effects  yields  an  average 
throughput  of  approximately  9.0  KBPS/node.  Thus,  the  traffic 
handling  capability  of  the  operating  net  can  be  expected  to  be 
close  to  the  nominal  throughput  under  ideal  conditions.  (In  fact, 
the  results  of  flow  sensitivity  analyses  under  varying  traffic 
requirements  and  perfect  component  operations  indicate  throughput, 
variations  of  10%-20%  are  to  be  expected  under  even  ideal  conditions.) 
An  alternative  interpretation  is  that  as  long  as  pair  of  nodes 
is  able  to  communicate  at  all  through  the  net,  the  network  will 
have  (1)  sufficient  capacity  and  (2)  the  routing  algorithms  will 
be  able  to  utilize  this  capacity  to  provide  acceptable  through¬ 
puts  . 
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TABLE  2.2.1 


EFFECTS  OF  LINK  FAILURES  ON  THROUGH PUT 


Link  Failure  Probability  =  0.02 
Expected  Throughput  =  10.1  KBPS/node 


I.  One  link  failed 

Sample  mean  =  9.1  KBPS/node  Sample  deviation  =  1.45  KBPS/node 

Empirical  distribution  function: 

Throughput 
less  than 


% 


• 

• 

6 

7 

8 

9 

10 

11 

12 

• 

• 

0 

7.1 

25.0 

46.4 

67.9 

85.7 

100 

Maximum  throughput  =  11.5  KBPS/node  Minimum  throughput  =  6.8KBP^node 


II.  Two  links  failed 

Sample  mean  =  7.0  KBPS/node  Sample  deviation  =  2.57  lJ3PS/node 
Empirical  distribution  function: 

6  7  8 

25.9  41.2  60.3 


Throughput 
less  than 

% 


0 

0 


1 

7.9 


2 

7.9 


3 

7.9 


4 

7.9 


5 

18.2 


10  11 


12 


83.1  94.6  99.5  100 


Maximum  throughput  •*'  11.2  KBPS/node  Minimum  throughput  =  0. 
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TABLE  2.2.2 


_  j  yFECTS  OF  NODE  FAILURES  ON  THROUGHPUT 

Node  Failure  Probability  =0.02 
Expected  throughput  =9.9  KBPS/node 


I. 


One  node  failed 

Sample  mean  =8.5  KBPS/node  Sample  deviation 
Empirical  distribution  function: 


=  1.64  KBPS/node 


Throughput 
less  than  : 


% 


4 

0 


8 


4.3  4.3  17.4  39.1 


9 

56.5 


10  11  i 

82.6  91.3  10 


Maximum  throughput  =11.10  KBPS/node  Minimum  throujhput  =  6.27  KBKphod, 


II.  Two  nodes  failed 

sample  mean  «  6.1  KBPS/node  Sample  deviation  -  2.72  KBPS/node 
Empirical  distribution  function: 

Throughput 

less  than  :01  2  34  5  67  8 

%  :  0  12.6  12.6  12.6  12.6  33.6  38.3  51.0  71.9 

9  10  11 

90.1  97.6  100 

Madmum  throughpat  -  l0.80KBPS^ode  Minimum  throughput  =  0. 
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TABLE  2.2. -3 


Single  Link  Failure 


Failed 


(KBPS/node 


-<-6.  in.) _ 

— (--fl».  J9 ) 

'-(-  S.-14) _ 

-LiQ.4-3)  _ 
-UJ  .-17) 

— (-1-1-*  1 5) 
-«?.  13) 
-M2.1-7-)- — 

-< 14,-?14 

-U-5.20U 
-(15.21) 
-(16.22-1 
-(15.20) 
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Links  Failed 

<  1*  3)  *  (  l,  5)’ 

<  1  *  3) * (  l ,  2) 

<  1*  3) * (  2,  3) 

<  1*  3) , (  2»22) 

<  1*  3) , (  2 »  4)  . 
(  1*  3)»(  4,23) 

(  1*  3) » (  4,  9) 

(  It  3) t (  4,18); 

<  1*  3)  t  (  ?t  16) 

<  1 »  3) t  (  5t  7) 

<  1*  3) ♦ (  5t 19) 

(  1»  3) , (  6t 19) 

(  It  3) t (  6 t  8) 

<  It  3) , (  6 1 1 0 ) _ 

(  It  3) t (  7 123) 

-(-lt„3)t.(  8 1  9) 

<  1  *  3) t (  8t 14) 
-Ut  3)  t  ( 1 0 1 13) 

*  3)  t  (11,17)' 

t-l»~3) , (11,15). 

1  3) , (12,13) 

<  1,  -3)  ,  (12,17) 
t-1 ,  3) , (14,21) 
3—1 »— 3)  ,  (15,20) 

<  1»  3) , (15,21) 

-(  1*  3),  (16,22)' 

(  It  .3).,  (18,20). 

(-  It  2)  ,  („1,  5) 

<  -1 »  2),(  2,  3) 
~Clr_2)^.(_2,  4) 

(-It  2) ,  (  .2,22).. 

(  1 ,  21.,  (  4,23) 

<  1,  2) , (  4,  9) 

(  1,  2)j  (_.4» 18) 

(  1 ,-  2 )  »  ( „.5 ,16) 

(  1,_2)  ,.<  5,  7) 

<  -1,  2)  ,  (  5,19) 

(  ~lt  2) ,  (.6,1 9 ) J 

.  (  1»  2) , (  6,  8) 

(  1*  2) , (  6,10) 

(  It  2) , (  7,23) 

(  1*  2) , (  8,9) 

(  1,  2) , (  8,14) , 

(  It  2), (10,13) 1 

(  It  2), (H,i7) 

(  it  2>, (11,15) 

(  1*  2), (12,13) 


Throughput 
(KBPS /node) 

10.57. 
10.84 
0.00 
11.00 
-  6.34 
..  9.27 
„7.39 
_  8.40 
10.35 • 
-9.53 
-7.26 
1—7.81 
10.15 
-6.76 
—9.44 
—8.49 
-8.65 
-7.68 
-8.00 
— 6 . 76. 
-9.59. 
—9.73 
-8.89. 
-7.30 
-  9.27. 
10.41 
-8.17„ 
.10.57 
-11.20, 

_  8.34_ 

-11 .10. 

—9  •  2  7_ 

—7.58 

-8.40 

10.57_ 

-9.8i_ 

-7.26. 

-7.8JU 

•10.13, 

-6*76 

.9.73 

-8.49, 

-8.65 
—7 .68^ 

-8.00, 

-  6..76J 
-9.59 


Links  Fai  1p.h 

(  It  2) , (12,17) 

(  I*  2) , (14,21) 
(1»  2) , (15,20) 

(  It  2), (15,21) 

<  It  2) , (16,22) 

(  It  2), (18,20) 

(  It  5) , (  2,  3)  ' 
(  It  5) , (  2,22) 

*(  1»  5)  f  (  2$  4) 

(  1,  5) , (  4,23) 

(  1 ,  5) , (  4,  9) 

(  -1 ,— 5)  ,  ( ,4 ,18). 

(  1*.5)*.(  5,19) 

(  1,  S) , (  5,16) 

(  1»  5) , (  5,  7 i 
(  1,  5) , (  6,19) 

.<  1 »  5) , (  6,  8)  • 

<  1 »  5) , (  6,10) 
-(— U_5)_,_(_7_,23)_ 
(— 1.»_5)  ,  (8,  9)_ 
(-1,  5) , (  8,14)1 
(  It.  5)  ,  (10,13).. 
(-1,-5)  ,(11,1 7)-- 
(-1,-5).,  (11,15) 

(— 1  ,_5)j  ( 12, 13)_ 

-(  -1,,5) ,  (12,17)  . 
(—1,-5) , (14,21) 
-Cl.,.  5),  (15,20) 
-(_it-5) ,  (15,21  f 
.(_1.»— 5) ,  (16,22)” 
-(— 1-*_ 5).,  (18,20 )_ 
(-2,— 3  ).,„(.  12,  4)  . 

(—2.,— 3 ) .,  (  2 ,22 ) 

C.  2  »._  3 )  ,  C4»23)„ 
(—2,-3),  (_4  ,__9 )._ 
(-2,— 3)  ,.(  „4>  18 )_ 
(-2,_3)  ,  (_ 5, 16) 

(  _2,.. 3) ,  (  .5,  7)_ 

( -2 ,._3)  »  (_5, 19) 

(  -2,  3) , (  6,19) 
C2t_3)  ,  (  6,  8) 

(  2»„3),(  6,10) 

A  2,  .3) ,  (  7,23)  j 
C2»  .3) ,  (  8,  9)  [ 

(  .2*_.3)  ,  (  8,14) 

A  -2,-3) ,  (10,13)  > 
C2,  3),  (11,171 


Throughput 

(KBPS/node) 

9.73 

8.89 

7.78 

9.27 

10.69 

8.59 

10.57 

9.73 

6.76 

9.16 

8.22 

-8.02. 

7.26 
i:  6.76 
8.94 
ri  7.81  ' 
10.06 
G  6.76 
-9._1.9_, 
18.48. 

— 8 . 66_ 

— 7.68_ 
L-7.68. 
-6.76. 
—9.52. 

C9. 01_ 
-8.89 
16.49 
-9.29 
8.00 
-7.16" 
-8.34 
10.39 
-8.46 
-7.21_ 
.8.39 
10.18 
-  9,77 
-7.26 
7,81 
10.17 
.6,76 
-9.73 
,..8 .27 
8.65 
L. 7.68 
8.0C 


mm 


Links  Failed 

<  2  ♦  3),  (U.  15) 

<  2 ♦  3) * ( 12* 13) 

<  2.  3), (12, 17) 

<  2,  3), (14,21) 
(  2,  3), (15, 20) 
(  2,  3) , (15*21) 

(  2,  3), (16,22) 

<  2,  3), (18*20) 

(  2,22) , (  2,  4) 

(  2,22) , (  4*23) 

(  2,22), (  4,  9) 

(  2,22), (  4,18) 

(  2,22) , (  5,16) 

(  2, *.2)  ,  (  5,  7) 

(  2,22) ,  (  5,19). 
(  2,22) , (  6,19) 

(  2,22) , (  6,  8) 

(  2*22), (  6,10) 

(  2,22) , (  7,23) 
(-2*22) *(  8,  9) 

(  2,22) , (  8,14) 

(  2,22) , (10,13) 

(  2,22) ,(11,17) 

(  2,22) , (11,15) 

(  2,22) , (12,13) 

(  2,22) , (12,17) 

(  2*22) , (14,21)  ! 

(  2*221,(15,20) 

(  2,22) , (15*21) 

(  2,22) , (16,22) 

-(-  2*22)  »  (18,20) 

(  2*  4) , (  4,18) 

(  2,  4) , (  4,23) 

(  2,  4) , (  4,  9) 

(  2,  4)  ,  (  5,16) 

(  2,  4) , (  5,  7) 

(  2,  4)  ,  (  5,19) 
2.»_4)_*_(_6,_  1 9 )_ 
(-2*— 4)  ,J_6,  8)_ 
(-2*— 4)  *  (  6,10)1 
1  2,  4),  (_7, 23) 
-(-2»_4).»  (_8*  9)_ 
(~2*_4),(  8, 14)_ 
(-2*— 4)  ,  (10,13)_ 
t-2»  4)  ,  (11,17)  > 
i(  -2 , — 4)  ,  (11,15)_ 
'^2*  -41  ,.( 12*13)  J 


Throughput 

(KBPS/node) 

-6.76 
_  9.59 
9.73 
8.88 
,  8.28 
'  9.28 
LI  0  •  94 
t  8.59' 
Cs.34  . 
c.  8.59 
i  7.03 
.  8.39 

i  0.00 

L  9.83 
,  7.26 
[-7.81 
9.81_ 

6  h  7  6. 
-9.73- 
f  e.06_ 

--8.64- 
-,7.68 
-8.00- 
_6.76 
-.9.59 
-9.73 
-8.87 
7.89  ! 

9.29 

o.ooj  . 

-8.5.9J 
7.58  !  • 

4.63 
6.49  j 
6.76  ! 

5.21 
4.86 
_4, 63_ 

-6.80- 
— 6*49_ 

-4.86- 

-7.41- 

L  8,62 , 

-7,68 

-8,00. 

1 — 6 .76, 

U8.S0_; 


_  Links  Failed 

U-2,  4), (12,17) 

(  2,  4), (14, 21) 
(-2,  4) , (15,20) 
-<  2,  4), (15, 21) 

(  .2,  4)  ,  (16, 22) 
(~2*  4)  ,(18,20) 
J— 4*23)  >X_4»18) 
.(..4,23)  ,  (  4,  9) 
-(—4  *  23 )  ,(5,16) 
-(_4, 23),  (  5,  71- 

.  -(-.4*23)  ,  (-5,19)- 

-(-4,23).,  (  6,19) 
(-4,23), (6,  8)1 
(-4,23) »(  6, 10)_ 
(— 4*23) * (  7,23) 
-(-4,23)  ,  (  8,  9) _ 
-(—4*23)  ,  (  8*14)_ 
-( -4.23)  *  ( 1 0 *  1 3 )__ 
-(-4,23)  ,  (11,17). 
(-4,23)  ,.( 11*15)_ 
-(-4*23).,  ( 12*13)— 
-(~4,23),(12,17)._ 
(.4  *23  ).*_(!  4, 21 )_ 
-(-4*23)  ,  (15,20 )_ 
-(-4,23)  ,  (15,21  )_ 
(-4,23) , ( 16*22)- 
r(- 4,23)  ♦  (18,20) 
-(—4* — 9)  ,  (L 4*  18)1 
-(— 4  *_9)  _*  (_  5»16)_ 
-(— 4*— 9)  *  (  5,  7)_ 
.(-4,-9),  (  5,19) 

(  4*  . .9)  ,  (..6,19) 
•(~4,J),16,  8)_ 
(— 4.,— 9)  ,  (  6,10) 
(—4,-9)  ,  (  7,23) 
-(-4*.-9),{  8*  9 ) 

(-  4*__9)  *  (  8,14) 
-(-4*.  9)  ,  (10,13)  .* 

( —4 *_  9 )  ,  (11,17) 

<  4,^9) ,  (u,i5) ; 
(4,  9) , (12,13) 
(-4,-9) , (12,17) 

(  4,  9) , (14,21) t 
;<  4*  9)  ,  (15,20) 
j(  -4,  9)  ,  (15,21) J 
(  4,  9) , (16,22) 

*(  '.4,^9)  *  (18*20) 


Throughput 

(KBPS/node) 

-8.46 
8.85 
-7.58. 
-9.14 
— L>  .00_ 
-7.58 
-8.39 
-6.63 
-9.24 
_0.00_ 

_ 5 . 0  7_ 
-4.63 
—7.61_ 
-6.49- 
-0.00_ 
-7.58  . 
-8.64, 
—7,68- 
— 8.00_ 
-6.76. 
-8.85- 
-8.98_ 
_8.87_ 
r-8.85- 
-9.16- 
1-9.27- 
l-8.59- 
4.49- 
,_7.58 
8.11... 
-4.42- 
_4.42 . 
-7.24- 
_6.76_ 

-7.30 
-0.00 
-7.84- 
_7.68_ 
j.._6 . 63  _ 

5.96 

L8.59 

—7.482 

7.84_ 

4.42 
.  6.50- 
I  7.30 
4.4  2 
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Throughput 

Throughput 

Links  Failed 

(KBPS/node) 

Links  Failed 

(KBPS/node) 

(  4 » 1 8 ) » (  5*16) 

7.50 

(  5,  7), (12*13) 

8.98 

(  4.18) ,  (  5*  7) 

l  8.40 

(  5,  7), (12.17) 

•i  8.85 

(  4*18) , (  5*19) 

-4.49 

(  5,  7), (14, 21) 

'  8.89 

(  4*18) t (  6*19) 

4.42 

(  5,  7) ,( 15,20) 

6.87 

(  4*18) *  (  6*  8) 

8.06 

(  5,  7) , (15,21) 

8.97 

(  4.18) » (  6*10) 

4.49 

(  5,  7) * (16*22) 

9.50 

{  4.18) . (  7»23) 

8.40 

(  5*  7) * (18,20) 

7.58 

(  4.18) » (  8*  9) 

i  4.42 

(  5,19), (  6,19) 

0.00 

(  4*18) * (  8*14) 

4.49  ' 

(  5*19), (  6,  8) 

5.21 

_( _ 4  *18)  ,  ( 1 0  *  1 3 )_ 

4.63 

(  5,19) , (  6*10) 

6.49 

(  4*18) * (11*17) 

;  5.96 

(  5, 19) * (  7,23) 

5.43 

(  4*18) * (11*15) 

‘  6.49 

(  5*19) *(8,9) 

4.42 

(  4*18) ♦ (12*13) 

-4.86 

(  5*19) , (  8,14) 

6.71 

(  4*18) . (12.17) 

_5.43 

1  (  5*19) * (10*13) 

7.39 

(  4*18) ♦ (14.21) 

4.63 

(  5*19), (11,17) 

5.72 

(  4.18) , (15.20)j 

^0.00 

(  5*19) , (11,15) 

L  5 .21 

(  4.18) . (15*21) 

j_ 4.86. 

<  5,19), (12,13) 

7.50. 

(.  4.18)  ,  (16,22). 

i_8.40 

(  5.19), (12,17) 

6.49 

(  4*18) * (18*20) 

Lo.oo 

(  5.19), (14,21) 

6.95,.. 

(  5*16)  »  (  .5,19) 

_7.26 

(.5,19), (15,20) 

4.42  [ 

(.  5*16)  ,  (.  5*  7)  J 

i_9. 35 

„(  5*19),  (15*21) 

6.70  i- 

(_5*lb)  •(  6  *  19 )_ 

L7.81 

-(-5*19)  ,  (16,22)- 

-7.26 

(  5*16) *  (  6*  8) 

10.13 

(  5,19), (18,20) 

4.42 

(.  5.16)  ,  (.  6.10). 

,_6.76 

(  6, 19) , {  6,10) 

6.49 

.(.5*16),  (  7*23) 

l.9.25. 

•  (  6*19) , (  6,  8) 

5.72 

..(  5*16)  *  (  8,  9). 

L8.49j 

!  (  6*19) , (  7*23) 

5.07 

(  5*16)  *  (  8,14). 

(-8.66 

!  (  6*19), (  8,  9) 

4.42 

(-5*16) * (10*13) 

1—7.68. 

(  6,19) * (  8*14) 

7.06 

(_5» 16) , (11,17) 

i-8.00. 

_(_ 6*_1.9)_».(.10  »13)_ 

_7.48j 

(  5*16) ,  (11,15).- 

-6.76 

•  L(_6,19)  ,  ( 11,17)_- 

6.49  i 

(.5*  16)  *  (12*13). 

.9.59 

_(_ 6,19)  ,  (11,1$)  j 

_5.72  j 

i  5.16) » (12,17) 

.-9.73 

.(  6,19), (12,13) 

7.40 !  • 

(  5,16)  ,  (14,21)^ 

-8.89J 

_(i_6 , 19).,  (12*17 )_i 

7.48  ! 

(  5,16) , (15,20) 

-6.21 

J  6,19), (14,21) 

6.99 

(  5*16), (15,21) 

_  9.31 

.(.6,19).,  (15,20) .. 

4.42 

(  5,16) , (16,22). 

-0.00, 

J  6,19) , (15,21) 

7.26 

(  5*16) , (18,20) 

-6*78 

J_6, 19),  (16,22)_. 

7.81 

(  5,  7) * (  5.19) 

1—5.96. 

6 , 1 9  ).,.l  1 8 , 2  0 )- 

4*r42. 

(  5*  7) , (  6,19) 

u.5.43 

_(_6»_ 8)  ,  (_ 6, 10)_ 

6.49 

(  5,  7)  ,  (  6*  8) 

_8.1L 

-(  _6»  8)  ,  <  7*23) 

7.79 

(  5,  7) , (  6,10) 

-6.49 

_{_6*_ 6) 8,  9) 

7.93 

(  5,  7 ) , (  7,23) 

^.0.00 

-(-6.  .8)  »  (  8,14) 

8.00 

(  5*  7) , (  8,  9) 

r-8.27. 

_(  .6,.  8)  *  (10,13) 

7.68 

(  5*  .7)  ,  (  8,14) 

'}— 8  •  66; 

A  .6,  8).,  (11*17) 

5.96 

(  5*  7) , (10,13) 

j_._7.68/  ■ 

.(_6,_ 8)  *(11,15)— 

5.21 

(  5,  7) » (11*17) 

j— 8.00- 

uC_ 6 ,_ 8 ) ,  (12,13) 

7.68 

(  5,  7)  *>(11,15)  * 

j _ 6 .76' 

/_l_6,_8L,.(i2,17L 

-6.Z6 
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Links  Failed 


..(  6,  6)  , (14*21) 

(  6.  6), (15,20) 

(  6.  8), (15. 21) 

(  6.  8), (16.22) 

(  6.  8), (18. 20) 

(  6.10)  .  (  7.23). 

(  6.10) . (  8.  9) 

(  6.10) . (  8.14) 

(  6.10). (10.13) 

(  6.10) . (11,17) 

(  6.10) , (11,15). 
-(  6.10) , (12.13). 
-(  6,10), (12.17) 
_(  6,10).  (14,21)_ 
(  6.10) , (15,20). 
-(  6,10), (15,21) 

(  6.10) , (16,22). 
-(  6.10) , (18,20) 

-  (.  7,23)  ,  (  8,  9).. 
-(  7 ,23)  ,  (  8»14)_ 
~(  7.23) , (10.13) 

(  7,23) , (11, 17)_ 
-i_7,23) , (11,15). 
-(.7,23), (12,13) 

(  7,23) , (12,17) 
-(-7,23) , (14,21) 

(  7,23) , (15,20). 
-( -  7,23) , (15,21) 

( -7,23) , (16,22). 
.(7,23) , (18,20) 

(  8,  9) , (  8,14). 

(  8,  9), (10,13). 

(  8,  9)  ,  (11,17). 

(  8,  9), (11,15) 

(  8,  9), (12,13) 
(8,9) , (12,17) 

(  8,  9), (14,21) 

(  8,  9), (15,20) 

(  8,  9) ,  (15,21) 

(  8,  9), (16,22)- 
-(  8,  9),  (18, 20). 

(  6,14), (10,13) 

(  8,14) , (11,17) 

(  8,14), (11,15) 

■  (  8,14) ,  (12,13) 

(  8,14) , (12,17)  , 
t  (  8 , 14) , ( 14,21 M 


Throughput 

(KBPS/node) 

8.06 
_7  •  7  0. 

-  8.00 
10.17., 
_7.82 
_6.49 
-6.49 
_4.49 
-.0.00 
-0.00 
-0.00 
-0.00 
-  0.00. 

— 4.63J 
—4.86 
-4.86 
L-6.76J 
_4.63 
-8.26. 

-8.65 

—7.68 j 

-8.00J 

-6.76. 

-8.8Sj 

-8.85.' 

—8  •  88_ 
-7.78.i 
i-9. 29j 
-9.4?- 
-8.59. 
t-7.83. 

J_7  •  68  j 
.7.41. 
j.  6.49_ 

-8.39. 

L8.26, 
j-  7.79 
_4.42 
j—7.34. 

-8.38 

f-4.42_ 

'-4.63 
5.96 
i  6.49 
*  4.86 
l  5.43 

f  o.oo ; 

-4-.  86 


Links  Failed 

Throughput 
(KB PS/node) 

-(  8,14) , (15,21) 

0.00 

-(  6,14) , (16,22) 

8.65 

(  8,14) , (16,20) 

4.63 

-(10,13) , (11*17) 

0.00 

- (10,13) ,  (11,15) 

0.00 

(10,13) » (12,13) 

\  0.00 

_(10,13), (12,17) 

i  o.oo 

-(10,13) , (14,21) 

t  4.86 

_ ( 1 0 , 13)  ,  (15,20) 

5.21 

-(10,13) , (IS, 21) 

5.43 

(10, 13) , (16,22) 

7.66 

..(10,13)  ,(18,20) 

4.86 

.-(11,17),  (11,15) 

0.00 

_(.11,17),  (12,13) 

0.00 

-(11,17) , (12,17) 

o.ooj 

-(11,17) , (14,21) 

6.76 

„(11,17) , (15,20) 

7.68 

-(11,17) , (15,21) 

.7.68 

-(11,17) ,  (16,22) 

8.00 

„(11,17) , (18,20) 

.6.76 

— (.1 1,15) ,  (12,13). 

0.00 

„(il,15)  ,  (12,17)- 

0.00 

-(11,15) ,  (14,21)_ 

-6.76 

-(11,15) , (15,20). 

1—6*76 

-(11,15) *  (15,21). 

-6.76 

-(11, 15) ,(16,22). 

_6.76  . 

-(11,15).,  (18,20). 

-6.76. 

-(12,13)  ,.(12,17). 

0.00 

-(12, 13)  ♦  (14,21) 

•  5.43 

-(12,13) ,  (15,20). 

_5.96 

-(12,13), (15,21) 

-5.96 

i— ( 12.,  13)  ,  (16,22). 

-9.54 

-(12,13) ♦  (16,20) 

5.43 

_( 12.,  17).,  (14,21) 

5.96 

.(12,17) , (15,20) 

6.76  , 

_( 12* 1 7) ♦ (15,21) 

6.76 

-(12,17)  ,  (16,22) 

9.73 

-(12,17), (18,20) 

5.96 

(14,21), (15,20) 

5.43 

-(14,21) , (15,21) 

0.00 

L(14, 21) , (16*22) 

8.88 

_(14, 21) , (18,20) 

j_ 4.86 

-( 15,20) , (15,21) 

5.96  ! 

-(15,20)  ,.(16, 22).j 

6.95 

-(15,20)  ,  (18,20)  J 

0.00 

_(15,21)  ,  (16,22) 

9.28 

>.(15,21)  ,  (18,20) 

5.43 

.(16,22) ,  (18,20) 

X.6t 
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TABLE  2.2.4 


EFFECTS  OF  NODE  FAILURES  ON  THROUGHPUT 


Single  Node  Failures 


Node 

Failed 

Throughput 
(KBPS /node) 

*10.44 

,_2 

8.46 

— 3 

11.06  » 

4 

4.56 

5 

6.27 

6 

6.27 

.  7 

• 

9.76 

8 

7.94 

9_ 

• 

7.65  i 

.  10 

7.40 

11 

7.71 

12 _ 

9.99  ‘ 

.13 

9.35 

_14 

8.72 

15 

6.54 

J6 

_ 10.66 

L  17 

9.75 

*  18 

8.40 

19 

7,81 

8.09 

_21  , 

v 

1- 

9.03 

22 _ 

11.10- 

-23  : 

- - '  - 

.. 

'  9.521 
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TWO  NODE  FAILURES 


Nodes  Throughput 

Failed  (KBPS /node) 


Node  Throughput 

Failed  (KBPS/node) 


M 


C 

}-: 


23  i 
2 


_5 

6 

7 

6 

9  r 
— » 

lOj 

ilj 

12j 

i3J 

14_ 


13 

14 

157 

1.6. 

17. 

ia. 

191 

20  J 

21 


9.37 
,  0.00 
•JLP_._6Q. 

i _4 .06* 

_6 . 92 
.  6.06 
_9  •  42 
_  7.96 
8 . 06  1 
d.7  •  1 3j 
.7.43 

13.62  • 

_6.97j 

—8.55. 


L,i5„ 

-.6.31. 

.1,16. 

-8.97* 

_l,17j 

La. 97, 

_1» 18j 

L8.22. 

—1_».1_9. 

l_7 .65* 

_1 ,20j 

L7.61. 

_1.,21_ 

.8.61. 

2  2j 

IJ0.06 

—2  ,j23j 

3-.94_ 

» _ 3j 

_ 9.67_ 

_2.i_4_ 

4.66 

_2,_5J 

^.o.oo^ 

_2,__6_ 

LA.j6.6_ 

-2»„7_ 

1-5.38. 

_2.».  8_ 

7,  40* 

_2  ,_  9. 

U6.13_ 

*2,10.. 

u-7. 13- 

2,11 

-7.43 

.2,12. 

-8.351 

L8.20J 
*  8.50  ' 
>  6.31j 

Lo.oo. 

-8..8.17 

_7.97_j 

U-4.94J 

1-7.9.6J 

a  .  a  .7_i 


( 


.  b 
6 
7 
a 

9 


'.2,22 
[  3*23 
3,  4 
'  3, 

„3» 

3. 

r-3» 

L3* 
3*10 
i.  3.  ii 
3,12 
.3  >1.3, 
1-3*  14_j 

r  3 » i 

^3,16 
3,17 
.3,16 
3,19] 
1  3>20J 

l  3,22 
4,23 

4,  5 


4,  6 
4,  7 

4,  6  ; 

UuSu 
— 4.*J.0_, 
— 4j.l-l_| 
]A,  12_: 
lA,_L3_ 
_4,.14.. 
(_4,d5 
-4, .1.6-] 
-4.,.17_] 
_4.,  18. 
_4_,. 19- 
LA  ,20- 
_A»Z1_ 
-4,22* 

5,  .6i 


9.67_ 
_  9.64 
4.66. 
_  6.92. 
6.06 

9.70 
7.92 

7.34 
7.13 

.7.43 

9.71 
8.97  ■ 

•__6.55j 

6.31 

10.07 

9.35 

6.21  ’ 

7.65 
8.45  , 

uAJUL 

10.60 

4.66 
0.00 
0.00 
0.00 
0.00 

_A.49_ 

__4.41_ 

_4.49_ 

_4.49_ 

i _ #►..  4.1_ 

i_.4.»49j 
0.00.4 
-4 ,66_ 
_4  •  49.. 
—4.49_! 
_0.0  0_ 
l.0*00_ 
i_4 . 4,9_ 
4.66* 

Lo..  00. 

LO.OQ* 
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Nodes 

Failed 


Throughput 


Nodes 

Failed 


Throughput 


—5* 

.7— 

-6.31- 

_ b , 

8 

L4.41_ 

_ b , 

9-j 

10 

_4.41_ 

b. 

_ .6.31_ 

b. 

11 

_5.38_ 

_b, 

12_ 

_6  • 0  6_ 

b , 

13_ 

—6 . 31_ , 

b. 

14  — 

-6.31- 

_.b « 

15- 

-4.41  , 

_..b « 

lb- 

-6.92-; 

_ b » 

17- 

-6.06- 

_b » 

18  J 

_4.49— 

_b  » 

19J 

—6.31— 

7,16- 
i  7 . 1  7 

'  9.23  _ 

_8i81__ 

7,18 

8.22 

7,19 

5.61 

7,20 

8.20 

7,21 

,  8.82 

7,22 

‘  9.80 

8,23 

1  7.69 

8,  9 

7.90 

8, 10_ 

4.49 

*__8,J1_ 

3.38- 

! _ 8,.12..J 

_4.94_ 

_ 8_,.l  3 _ 

_4.66 _ 

20 
21 
22_ 
23  _ 
7_ 
_8j 
_  9 
i0_* 

1U 

12_ 

1_3_ 

14_ 

IS 

.1.6  , 

17 

1«J 

19„, 

2-0— ! 

21 

22_ 

23- 

8_ 

_.9j 

10-.; 

ii. ; 
12_, 
13  ' 

14..' 

15 


_ 4 . 4 1_ • 
_6.06_ 
-0.00- 
_ 4.66_ 
_4.94_ 
_4  • 4 1_ 
—4.4.1— . 
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ECONOMIC  CONSIDERATIONS 


2.3.1  Peak  Throughput 

Usage  of  the  ARPA  Network  will  differ  from  node  to  node. 
Generally,  one  can  expect  two  kinds  of  users  in  the  net— those 
whose  peak  bandwidth  requirements  are  not  very  different  than 
their  average  bandwidth  needs  and  those  who  occasionally  require 
very  high  bandwidths  in  relation  to  their  average  usage.  The 
latter  case  includes  users  employing  interactive  graphics. 

The  ARPA  Network  as  presently  configured  allows  a  typical 
user  to  enter  or  receive  transmissions  at  a  peak  rate  of  about  85  KBPS 
if  the  net  is  not  heavily  loaded.  Some  users  may  never  require  such 
capacities.  The  question  which  then  arises  is:  can  average  service 
of  about  6  KBPS  per  node  be  provided  to  such  users  at  a  lower  cost 
than  that  presently  obtainable  by  the  ARPA  Network. 

Average  requirements  of  6  KBPS  per  node  and  2-connectivity  can 
be  supplied  by  installing  two  9.6  KBPS  links  at  the  node  requiring  only 
low  peak  throughput.  Since  the  monthly  cost  for  such  a  line,  §650 
plus  §0. 40/mile,  is  significantly  lower  than  the  §850  plus  §5. 00/mile 
for  a  50  KBPS  line,  one  might  think  that  considerable  savings  would 
result  for  a  node  not  requiring  high  peak  throughput.  To  test  this 
hypothesis,  the  following  experiment  was  performed. 

The  thirty  nodes  presently  in  or  under  consideration  for  the 
ARPA  net  were  considered  with  ten  additional  nodes  chosen  from  the 
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largest  metropolitan  areas  not  represented  by  the  first  thirty. 

A  low  cost  40  node  network  was  then  derived  using  only  50  KBPS  lines. 

This  network  is  shown  in  Figuxe  2.1.2(g)  and  the  noues  used  are  listed 
in  Table  2.1.1.  The  40  node  network  had  a  cost  of  $1,025,000  and 
a  throughput  of  6.0  KBPS/node.  Then,  five  sets  of  twenty  nodes  each 
were  randomly  selected  from  among  the  forty  nodes.  Each  node  in 
each  set  of  twenty  nodes  was  assumed  to  require  low  peak  bandwidths 
so  that  these  nodes  could  be  connected  into  the  net  by  either  9.6  KBPS 
or  50  KBPS  lines,  whichever  was  more  economical.  The  network  struc¬ 
ture  was  separately  optimized  for  each  set  of  twenty  nodes  and  the 
cost  savings  achieved  by  allowing  the  9.6  KBPS  lines  was  calculated. 
Finally,  all  forty  nodes  were  assumed  to  require  only  low  peak  through- 

0 

puts  and  the  network  optimization  was  repeated. 

•ihe  results  of  the  experiments  dramatically  indicated  that  the 
9.6  KBPS  line  option  is  not  generally  useful  for  the  ARPA  Network. 

In  the  vast  majority  of  cases,  even  when  the  9.6  KBPS  lines  were 
allowed,  the  NAC  computer  optimization  programs  selected  50  KBPS  lines 
for  the  most  economical  configuration.  In  fact,  in  only  three  cases 
were  9.6  KBPS  lines  found  useful.  These  cases  are  listed  in  Table  2.3.1 
and  illustrated  in  Figures  2.3.1,  2.3.2,  and  2*. 3. 3.  The  twenty  randomly 
selected  nodes  for  each  optimization  are  listed  in  Table  2.3.2,  and 
the  results  of  the  optimizations, in  Table  2.3.3. 
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Transformation  A:  Save  $25 ,500/year 


Tr  ansformation 


TWENTY 

Group 

I 

II. 

III. 

IV. 

V. 

VI. 


TABLE  2.3.1 


TRANSFORMATIONS  FOR  9.6  KBS  LIMBS 


Trans  formation 


Applicable  for  9.6  KBS 
at  Node 


A 

B 

C 


39 

37 

23 


Throughput  unaffected. 


TABLE  2.3.2 

RANDOMLY  SEU5CTED  NODES  FOR  WHICH  9.6  KBPS  LINES  ARE  ACCEPT  Am. V. 
Node  Numbers 


1. 

4,  5, 

-  6, 

9, 

10, 

11# 

12  # 

15, 

20, 

21, 

22, 

23, 

25, 

30, 

33, 

r  34, 

35, 

37, 

39 

t 

1. 

2,  3, 

■  5, 

6, 

10, 

11# 

12, 

15, 

16# 

18, 

19, 

22, 

28, 

31, 

34, 

,  35, 

36, 

37, 

39 

1, 

2,  7, 

9. 

11# 

13, 

16, 

20, 

21, 

24, 

28, 

29, 

30, 

31, 

32, 

33 1 

34, 

35, 

36, 

37 

i. 

2,  3, 

4, 

5, 

6,  7 

,  8, 

11# 

14, 

21, 

24, 

25, 

26, 

28, 

29, 

33, 

35, 

37, 

39 

•  - 

4, 

5,  7, 

8, 

9, 

10, 

11, 

13# 

14, 

15, 

17. 

20, 

25, 

27, 

28, 

30, 

31, 

33, 

35, 

38 

All  nodes. 
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TABLE  2.  3.  3 


NETS  WITH  9.6  KBS  fclNES 


Nodes  which  can  Trans forma-  Cost 


have  9.6  K  Lines 

tions  Used 

K$ 

Throuqhput 

Group  I 

A,  B,  C 

973.74 

All  throughputs 

for  I 

-  V, 

6.0  KBS/Node 

Group  II 

A,  B 

992.77 

34  K  E&cke  VlHr/iJode 

Group  in 

B 

1,018.30 

4 

Group  IV 

A,  B 

992.77 

Group  v 

Group  VI 


None  1,025.51 

i 

A,  B,  C  973.74 


All  nodes  allowed  Complete  Redesign  789.72  5.72  KBS/Node 

(average  delay  34  k  Padcet/fcr/Node 

1.0  seconds) 


Note:  Nets  for  Group  i-iv  all  deliver  average  time  delay  no 
greater  than  0.2  seconds. 

%’  *  ,4  *  *  * 
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Best  40  Node  Net  Allowing-  all  9.6  KBS  Nodes 


let  in  (a)  redrawn 


I  23 


FIGURE  2. 4. 0. 


an  interesting  variation 


Here  some  nodes,  judiciously  selected  are 
connected  by  a  50  »  .  '  re 

»  U  KBPS  o*- os  s -country  path 
yieiding  an  average  delay  of  .35  seconds 
but  low  peak  capacities. 


$854.46  K 


6.0  KBS/Node 


34.4  K  Pactets/hitfiode 


50  KBPS 


9.6  KBPS 


The  yearly  network  line  costs  for  the  various  optimizations 
ranged  from  a  low  of  $973,740  to  $1,025,510.  The  maximum  savings 
$51,770,  which  would  have  to  be  averaged  over  20  nodes,  represents 
only  10  percent  of  the  line  cost  per  node  which  itself  is  only 
approximately  half  the  overall  cost  per  node.  Furthermore,  the 
average  savings  for  the  entire  $1,025,000  network  is  less  than 
$25,000.  a  very  small  savings  in  return  for  a  loss  of  high  peak 
.  capacity  for  half  the  network. 

The  strong  conclusion  is  that  except  in  a  few  special  cases 
(such  as  connecting  a  low  requirement  Seattle  node),  it  is  undesir¬ 
able  to  use  9.6  KBPS  lines  in  the  ARPA  Network. 

2.3.2  Incremental  Costs 

* 

The  rapid  growth  of  the  ARPA  Network  creates  the  problem  of 
equitably  distributing  the  cost  of  the  network  over  its  community 
of  users.  There  are  two  kinds  of  network  users — ARPA  contractors 
at  universities  and  research  centers  and  non-ARPA  contractors  who 
are  joining  the  network  to  utilize  resources  such  as  the  ILLIAC  IV. 
The  former  group  of  users  have  been  principally  responsible  for  the 
growth  and  development  of  the  networx  and  the  transition  from  an  * 
experimental  project  to  a  viable,  economic  tool  broadly  applicable 
to  Defense  Department  communication  problems.  The  letter  user  group 
is  contributing  the  operating  environment  that  will  allow  the  network 
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experiment  to  proceed  from  a  specialised  one  to  a  general  purpose 
one. 

problem  of  distributing  costs  between  the  two  user  groups 

“  SUbjSOt  °f  tMS  S6Cti0n-  There  “•  several  reasonable  ways 
to  attach  this  problem.  Our  approach  is  as  follows: 

11  15  n0de  n6tWOrk  sh°™  in  figure  2.3.1  connecting  the 

.  original  set  of  AREA  eontractors  ls  ^  examined(  ^  ^ 

-  put  and  cost  determined.  To  evalua+o  „  ..  , 

To  evaluate  network  throughput,  two  types 

lyses  are  used.  The  first  assumes  equal  traffic  between  all 

nodes  and  the  flow  per  node  leading  to  an  average  time 

delay  of  0.2  seconds  is  calculated.  The  second  considers  five 

nodes  BBN,  UCLA,  ucSB,  SRI,  and  MIT-as  network  resources.  Equal 

traffic  from  all  nodes  to,  these  nodes  is  assumed  but  the  return 

irarfic  from  each  of  the  five  nodes  to  all  sides  is  assumed  to  be 

ten  times  as  great  as  the  forward  traffic.  The  average  throughput 

per  node  with  this  traffic  pattern  is  then  calculated  at  a  0.2 
second  time  delay. 

2)  A  26  node  network  is  derived  by  adding  11  new  user  nodes 
in  the  second  category  to  the  original  15  node  net'.  The  augments- 

made  to  minimize  the  incremental  cost  of  addihg  the  11  nbdes, 
without  regard  to  throughout.  The  throughput  of  the  26-node  net, 
which  is  shown  in  Figure  2.3.2,  is  calculated  under  a  variety  of 
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conditions.  The  traffic  matrix  TR  =  [tr^]  where  tri(j  is  the 
flow  from  node  i  to  node  j  is  partitioned  in  the  following  manner. 


Original 


original 
15  nodes 


11  new  nodes 


15  nodes 

11 

New  nodes 

( 

- 

S  1 

{ 

TRX 

1 

TR2 

V. 

r 

—  —  -  -  - 

1 

•  m  « 

1 

l 

tr3 

R 

1 

1 

TR4 

• 

■ 

The  traffic  in  each  of  the  four  submatrices  is  adjusted  independent!. 
Using  varying  traffic  patterns  the  flows  in  TR,  are  selected  to 
yield  a  specified  percentage  of  the  full  lead  that  could  be  handled 
by  the  15-node  network.  The  maximum  amount  of  traffic  that  can  then 
be  sent  from  the  11  new  nodes  is  then  calculated  under  several  dif¬ 
ferent  assumptions  about  traffic  patterns,  m  some  of  these  calcu¬ 
lations.  NASA  and  NCAR  are  considered  to  be  additional  network 
resources. 

3)  The  planned  26-node  network  shown  in  Figure  3.2.3  is 
analyzed  in  the  same  manner  as  the  network  discussed  in  2). 

The  object  of  the  three  analyses  is  to  compute  the  incremental 
cost  to  add  the  new  nodes  into  the  network,  the  cost  required  to 
provide  service  equivalent  to  that  provided  by  the  15-node  network 

to  the  original  15  nodes,  the  throughput  that  can  be  supplied  to 
•he  new  nodes  if  this  should  be  required. 
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The  results  of  the  analyses  are  shown  in  Table  2.3.4 
Simple  conclusions  that  can  be  reached  from  this  table  are: 

1)  A  fixed  line  cost  of  approximately  $16,500  per  new 
node  is  directly  attributable  to  the  addition  of  the  new  nodes 

if  the  cost  of  the  15-node  net  is  subtracted  from  the  cost  of  the 
26-node  net. 

2)  Depending  on  the  traffic  pattern,  the  new  nodes  can 
transmit  between  0  and  25  kilopackets  per  hour  in  the  26-node  net 
if  the  original  nodes  receive  throughput  equal  to  that  provided  by 
the  15-node  network.  Additional  throughput  can  only  be  provided 
to  the  new  nodes  by  degrading  the  service  to  the  original  nodes 

or  adding  new  communication  links  to  the  network.  Our  previous 
studies  have  shown  that  the  incremental  cost  per  megabit  (or 
kilopacket)  to  add  network  capacity  is  about  12.5  cents  if  the 
network  is  ideally  operated  24  hours,  7  days  a  week  (168  hours  per 
week) .  Therefore,  under  more  typical  6  day,  12-hour  service,  the  . 
incremental  cost  per  kilopacket  is  approximately  30  cents. 
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BBN, UCLA, UCSB, SRI, MIT 
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ROUTING  STRATEGIST  FOR  COMPUTER  NETWORK  DESIGN 


3 . 1  The  Routing  Problem 

The  routing  problem  in  a  communication  network  is  to  define 
a  set  of  rules  determining  the  path(s)  over  which  messages  should 
flow  from  one  site  to  another.  This  problem  is  extremely  complex, 
especially  for  a  network  of  computers.  A  good  routing  procedure 
must  be  a  compromise  between  three  somewhat  conflicting  require¬ 
ments:  (1)  The  efficiency  of  any  network  design  requires  that 

the  routing  procedure  make  full  use  of  available  line  capacities. 
This  can  be  interpreted  <_s  either  minimizing  the  average  delay 
from  message  inception  to  arrival  subject  to  a  set  of  flow  re¬ 
quirements  or  maximizing  the  throughput  subject  to  a  specified 
maximum  delay.  (2)  The  repeated  use  of  the  routing  procedure 
during  the  design  process  roquires  it  to  be  inexpensive  to  apply. 
Thus,. it  must  be  computationally  efficient.  (3)  The  procedure 
should  be  realistic.  It  should  be  similar  to  the  one  to  be 

»  s 

actually  implemented  in  the  final  operating  network  and  have 

\ 

the  same  general  characteristics. 

The  objective  that  the  delay  be  minimized  subject  to  a 
set  of  flow  constrants  makes  the  routing  problem  a  variation  of 
a  nonlinear  multicommodity  flow  problem.  This  problem  which 
was  discussed  in  our  Second  Semiannual  Report  can  be  readily 
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formulated  as  a  separable  convex  programming  problem  with  the 
delay  as  the  objective  function  and  the  conservation  of  flow  and 
capacity  limitations  as  the  constraints. 

The  minimum  delay  or  maximum  throughput  can  be  achieved  if 
the  routing  procedure  follows  the  solution  of  the  programming 
problem.  However,  for  networks  with  more  than  a  few  nodes  it 
is  not  computationally  efficient  to  solve  the  programming  problem, 
and  this  approach  is  extremely  expansive  for  repeated  applications 
of  the  routing  algorithm  for  use  during  the  design  stage. 

By  careful  analysis  of  the  solutions  from  the  mathematical 
programming  approach,  it  can  be  observed  that  most  (over  80%  in 
our  studies)  of  all  flow  requirements  are  routed  over  path3 
with  the  minimum  number  of  nodes.  A  heuristic  (described  in 
Semiannual  Reports  1  and  2) deduced  from  this  observation  is 
to  route  flow  over  the  least  utilized  such  paths.  This  approach 
gives  a  result  within  5%-20%  of  the  optimum.  In  addition  to 
being  fast  (over  three  orders  of  magnitude  fester  than  the  pro¬ 
gramming  approach) it  facilitates  minor  changes  of  the  network 
structure.  On  the  other  hand,  it  does  not  take  advantage  of 

routing,  and  the  variations  in  link  capacties,  and  leaves 

room  for  considerable  improvements  especially  in  the  case  when 

the  netwbrk  contains  a  wide  distribution  of  different  line 

capacities.  (An  apparently  desirable  characteristic  of  very 

% 

large  networks). 
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The  routing  procedure  discussed  in  detail  in  this  chapter 
is  a  heuristic  one  allowing  split  routing.  Different  types  cf 
flows  are  simultaneously  routed  over  the  paths  with  minimum  num¬ 
bers  of  nodes.  (These  paths  are  "shortest  paths"  using  a  simple 
unit  metric  for  each  line.)  When  no  shortest  path  with  excess 
capacity  is  available,  the  saturated  lines  are  deleted  from  the 
network  and  flows  are  then  routed  over  the  shortest  paths  of  the 
remaining  subnetwork.  The  process  is  continued  until  the  net¬ 
work  is  disconnected.  Equally  important,  the  algorithms  used 
represent  a  major  computational  breakthrough  for  the  shortest 
path  problem.  The  main  algorithm  is  based  on  "Floyd's  algorithm" 
with  special  recognition  of  the  fact  that  the  node  degrees  in  a 
computer  network  are  usually  low.  By  this  technique,  a  message 
is  sent  down  a  path  with  fewest  intermediate  nodes  and  excess 
capacity,  or  when  that  path  is  filled,  the  one  with  next  fewest 
intermediate  nodes  and  excess  capacity,  etc.  Computationwise, 
it  is  in  the  same  order  of  magnitude,  but  faster  than  the  first 
heuristic  ipproach.  Yet  its  results  are  extremely  close  to  the 
optimal  solution  during  heavy  traffic.  Furthermore,  the  routing 
strategy  is  very  similar  to  physical  routing  schemes  under  study 
for  the  ARPA  Network  and  it  exhibits  analogous  behaviorial 
properties . 
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3.2  A  Modified  Routing  Algorithm  for  “ARPA-liko"  Networks 


It  was  shown  in  our  Second  Semiannual  Report  thac  the 
heuristic  minimum  node  routing  strategy  would  yield  a  near 
optimal  solution  (within  5%  to  20S) .  This  heuristic  algorithm 
described  is  especially  efficient  during  the  network  optimiza¬ 
tion  process.  However,  it  has  two  drawbacks  when  it  is  used  for 
the  sole  purpose  of  traffic  routing.  First,  all  minimum  node 
paths  between  each  node  pair  are  generated  while  only  one  path 
is  used.  Computer  time  may  be  saved  if  only  the  paths  to  be 
actually  used  are  generated.  Second,  the  routing  process  ter¬ 
minates  if  any  one  link  is  saturated.  Higher  throughput  could 
be  obtained  if  alternate  paths  are  then'  used. 

The  new  routing  algorithm  provides  the  two  improvements 
described.  Rased  on  Floyd's  algorithm  [3,  4],  minimum  node  paths 
(hereafter  called  shortest  paths)  are  generated  between  all  node 
pairs.  The  required  traffic  is  then  routed  over  the  unique  path 
for  each  node  pair.  The  traffic  flow  between  each  node  pair 
and  on  each  link  is  then  uniformly  increased  or  decreased  until 
the  flow  is  equal  to  the  capacity  for  the  most  utilized  link. 

The  saturated  link(s)  is  then  removed  from  the  network  and  the 
capacity  on  each  link  is  replaced  by  its  residual  capacity  at 
this  point.  A  shortest  path  is  again  generated  for  each  node 
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pair  and  additional  traffic  is  routed  as  before.  The  process 
is  repeated  until  the  network  is  disconnected.  Although  the 
approach  rs  heuristic,  the  rest, It  is  so  close  to  the  optical  one 
for  high  traffic  that  no  significant  difference  can  be  observed 
for  the  networks  we  have  studied  and  there  is  no  need  to  draw 
the  delay  curves  for  comparison. 

Using  Floyd's  algorithm,  the  distance  matrix  D  =  [  d.  .]  and 

Path  “atriX  P  "  [Pi.j]  are  defined  so  that  d±#j  is  the  distance 
x  and  and  P^j  is  the  first  intermediate  node  on  the 
shortest  path  from  1  to  j .  Let  NN  be  the  number  of  nodes  in  the 
network.  To  generate  minimum  node  paths,  d±# j  may  be  initially 
set  equal  to  unity.  On  the  other  hand/  it  is  easy  to  use  many 

other  path  selection  criteria  by  judiciously  selecting  other 
values  of  the  di  ^ . 

x,  j 


A  Basic  Algorithm  (Floyd's  Algorithm^  > 

Step  0.  Set  D  =  [difj]  and  initialize  the  path  matrix  P 
such  that 

di,3  - 

(°°  otherwise 


tPi.j] 


idirect  distance  between  i  and  i  if  i  is 
j  connected  to  j.  J  1  1S 


x.  .  _  J  j  if  i  is  connected  to  i 

S  J 

V.  0  otherwise 


Let  r  =  1. 
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“tep  x.  For  1  -  1,  2,  .  NN  and  j  -  1,  2,  . ..,  NN  (if  d  is  symmetric; 

the  above  statement  is  replaced  by  i  =  l,2, ..  .,  NN-lam  j  =  i+l,..,  NN) 


let 

.  p. 

if  dj  j  <  d  +  d 

p  -J 

f 

i/l  s  i, r  r,} 

i<j  I 

lpi,r 

if  di  j.  >  d;  _  +  d_  x 
i/j  i<r  r,  ] 

di.:  - 

Min 

{  di, j'  di,r  +  dr,  j } 

Step  2.  Stop  if  r  =  NN.  Otherwise,  let  r  =  r+1  and  go  to  Step  1. 

The  computation  complexity  of  this  algorithm  is  on  the  order 

3 

of  NN  ,  and  for  a  long  time  this  algorithm  has  been  generally 
recognized  to  be  the  moot  computationally  efficient  general 
shortest  path  algorithm.  However,  its  drawback  is  its  failure 
to  take  advantage  of  both  low  degree  and  high  degree  nodes. 

For  instance,  the  distance  and  path  matrices  for  a  tree  network 
are  easily  obtained  with  a  compel  a* :  on  the  order  of  NN2.  On 

the  other  hand,  if  the  initial  distance  matrix  satisfies  the 
triangle  inequality  (di#Jc  +  dk>  j  £  d^j  for  all  i,  j,  k)  and  the 
network  is  close  to  a  complete  graph,  the  computation  complexity 
is  on  the  order  of  NN. 

The  implementation  of  the  routing  strategy  given  below 
specifically  generates  time  savings  by  individually  considering 
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high  and  low  degree  nodes.  As  a  result,  computational  complexity 
is  reduced  to  an  order  close  to  NN2  for  networks  like  the  ARPA 
net.  Detailed  experience  with  running  times  is  given  in  the 

next  section  as  is  a  generalized  algorithm  for  the  shortest  path 
problem. 

Improved  Routing  Alu^  ^thm 

Step  0.  Initially,  d  and  P  are  given  as  before. 
steP  !•  Removal  of  Pendant 

Remove  all  nodes  with  degree  of  1  and  reduce  the  degree 
of  their  adjacent  nodes,  go  to  Step  2  if  all  nodes  in  the  network 
so  obtained  have  a  degree  equal  to  2  or  greater,  stop  if  a  node's 
degree  is  reduced  to  zero.  (In  this  later  case,  the  original  net¬ 
work  is  not  connected  if  the  number  of  nodes  removed  so  far  is 
less  than  NN-1.  otherwise,  it  is  a  tree.)  Repeat  the  process 
until  a  termination  condition  is  met. 

Step  2 .  Removal  of  Nodes  with  Degree  Two 

Let  i  be  any  node  of  degree  2  and  let  j  and  k  be  its 

adjacent  nodes.  If  d?  >  d*  +  , 

j,k  j ,  i 

Set  d££  .  .  Min  [dj£.,  dJ_J 

j  and  k  to  be  adjacent. 
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i,j,  set  Pj(£“Pj(i  and  P^J-PU, 
+  di,k|  and  consider  nodes 


> 


Step 

3.0 

3.1 

3.1.1. 

3.1.2. 

3.1.3. 

3.2 


3‘  £abeli"<r  rcodgs  with  n.Tr.«  Greater  than  too 

Lot  0  bo  the  sot  of  nodoa  of  dogroe  greater  than  2  and 
let  N'  be  the  number  of  such  nodes. 

Let  '  be  any  element  of  Q 

Set  A0  =  (i ')  and  ^  ■  i  •  and  let  k  =  1  L  =  1 

Let  Ak  “  For  each  j  adjacent  to  bk  but  not  in 

Ak,  let  L  =  1*1,  bL  =  j,  and  \  U  (j) 


If  \  *  \-i'  let  k  =  k+1  and  go  to  3.1.1. 

If  IV  **  stop.  (if,Ak|  f  N*,the  net  is'not  connected.) 
Otherwise,  set  Am  =  Ak  for  m  -  k+1 . . . 

Define  0i  =  fh'  |  h  £  Q  and  .  di<h  .  »  in 

initial  distance  matrixj 

For  r  «  1,  2 . N*  let  r1  =  br  and  for  i€Ak  and 

j  £  C±  set 


Pj^i  #  if  di,j  *di,r  +  dr,  . 
lpr,i  otherwise. 

i.j  -  h if  ^ *  di-r' + 

\Pi,r’  otherwise 


and 


d  •  .  =  <j 
J #  x  •  ui 


i.j  '  ““  <Ji<r.  +  dr,<:j| 
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Step  4.  Labeling  Nodes  of  Degree  Two 


Return  degree  two  nodes  to  the  net  in  the  sequence 
opposite  to  the  one  with  which  they  were  removed  in 
Step  2  (i. e. ,  last  node  removed  is  first  node  returned, 

A. 

etc.)  For  each  node  i  in  this  sequence  with  adjacent 

A  A 

nodes  j  and  k,  and  for  any  j  £  Q,  let 


df  f  +  d*  .  $  a*  A  +  d* 

9  J  J  *  J  k/  j 

otherwise. 


if  d<"  *  + 
-1/  J 

otherwise 


aj,i  =  j  ’  Min  {di.  J  +  j  '  +  dfi,  j  j 

Let  Q  =  Q  U [i J  . 

Step  5.  Labeling  Pendant  Nodes 

Return  pendant  nodes  to  the  net  in  the  opposite  sequence 

9 

to  the  one  with  which  they  were  removed  in  Step  1.  For 
each  node  i  in  this  sequence  with  adjacent  node  k,  and 
for  any  j  €  q,  let 
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pj.£  =  pj.i? 


a.  a=  dtj  + 

Let  Q  =  U  {1}  . 


The  above  steps  generate  shortest  paths  for  all  node  pairs. 
The  steps  separately  consider  degree  one  and  two  nodes.  For 
large  nets  with  higher  average  degrees,  it  is  also  possible  to 
consider  separately  degree  three,  four,  ...,  nodes,  with  consid¬ 
erable  computation  savings.  However,  the  average  degree  of  a 
node  in  the  ARPA  net  is  about  2.2  and  so  these  steps  are  not 
necessary.  The  next  step  is  to  determine  the  traffic  on  each 
link.  A  straightforward  method  is  to  obtain  the  shortest  path 
for  each  node  pair  from  the  path  matrix  and  add  the  flow  for  this 
node  pair  to  each  link  of  the  path.  This  method  would  require 
a  computation  complexity  of  NN  .  We  therefore  use  the  following 
approach  which  requires  only  NN  operations.  In  each  such 
operation,  a  tree  representing  a  combination  of  NN-1  paths  is 
searched  instead  of  all  individual  paths. 


Step  6'  assign  link  flo.... 


L6t  ETR  <»-»  ^  the  flow  < 


For  each  i  -  i  p 

J  •  •  •»  NN, 

Let  TR(i)  be  the  remn'vo.  x= 


ln  the  link  (a#b)  from 


a  to  b. 


f  .  --qui,ed  floW  fromnodeito 

for  x  a  1  p  J 

•  •••,  m. 

Let  J  =  /  i,.  ^  . 


X  3k  for  k  =  i 

v  *  •  •  •  / 


if  k*  >  k"j. 

For  k  =  i  p 

'  '  •••'  N  3ke  J,  let 

TR(P3k#3}  =  TR^Pjk/j)  +  TR(jk) 

For  i  =  i  p 

'  '  **•'  NN/  set  btr  1 1'  ~ 


NN  such  that  d- 


set  BTR(i,p  ,  . 

*'3  TR(l#Pi/j)+  TR  (i  \ 


Exanples 


The  network  routina 

outmg  proceaure  for  store-an^  * 

nets  is  used  in  con •  "  0rward  computer 

a  ln  conjunction  with  ^  , 

predict  levels  of  *  "'0del8  to  " 

revels  of  network  traffic  that  „  w 

out  exceeding  the  appropriate  J(  6  -oattodated  with- 

-  this  constraint  is  0  Her  :  ~ 

model  is  described  in  the  Second  s  11,0  tln>e  d6Uy  analySiS 

a''era3e  time  «•!*  =an  be  written  as  the 
delays  over  the  circuits.  If  T  .  a 

i-th  link  ch  "  he  ",ean  delaV  time  on  the 

'  he"  the  delay  time  ,  is 


.  -IZA.  T 

i  ■  er  1 

where  A.  is  the  total  number  of  packets  on  the  i-th  link  per 

unit  time  and  *  is  the  total  number  of  packets  per  unit  time 
entering  the  network. 

“  Ci  "  thS  °aPaCity  °f  the  V/"  the  average 

length  of  a  Host  packet,  and  l//<  the  average  length  of  all  ' 

packets  in  the  system  including  acknowledgments,  reguests  for 

next  messages,  headers,  acknowledgments,  parity  checks,  etc, 

t'  J"  T  oan  explicitly  written  as 


r  "Y'  |X-f  [-cl-  4.  .  1  Ai//<C, 

i  U  ^Ci  ^  I^-+"i  + 


The  expression 


-sA - +  _ 1_  _Ai//<ci 

^ci  /"<* 


represents  the  average  time  delay  experienced  on  the  i-th  link 
by  an  information  packet,  -,-he  term 


1  Ai//‘ci 

1-Ai/Yci 
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is  the  average  time  an  information  packet  spends  waiting  at  the 
IMP  for  the  i-tb  link  to  become  available.  Since  the  informa¬ 
tion  packet  must  compete  with  acknowledgments  and  other  overhead 
traffic,  the  overall  message  length  1 .//*  appears  in  the  expression 
The  term  1/c^/?  is  the  time  required  to  transmit  an  information 
packet  of  average  length  1//*'  .  Finally,  k  is  the  nodal  process¬ 
ing  time,  assumed  constant  and  for  the  ARPA  IMP,  approximately 
equal  to  0.3  ms;  Pi  is  the  propagation  time  on  the  i-th  link 
(about  20  ms  for  a  cross  country  link)  . 

This  formula  used  in  conjunction  with  a  static  routing 
procedure  to  specify  the  link  flows,  is  extremely  useful  to  ob¬ 
tain  curves  of  estimated  time  delay.  For  example,  consider 
the  ten  node  AP.PA  Network  shown  in  Figure  3.2.1.  Using  the  new 
rou^nST  procedure  described  and  equal  traffic  requirements  be¬ 
tween  all  node  ^^irs,  the  A^  were  found  and  the  delay  curves 
shown  in  Figure  3.2.2  were  obtained.  Curve  A  was  obtained  with 
fixed  1000  bit  packets*  while  curve  B  was  generated  for  exponen¬ 
tially  distributed  variable  length  packets  with  average  size 
of  500  bits,  in  both  cases,  all  overhead  factors  were  ignored. 
Note  that  the  delay  remains  small  until  a  throughput  slightly 
greater  than  40  kilobits/second/lMP  is  reached.  The  delay  then 
increases  rapidly.  Curves  c  and  D  represent  the  same  situations 


when  all  overhead  factors  are  included.  Notice  that  the  through¬ 
put  per  IMP  is  reduced  to  25  kilobits/second  in  case  c  and  to 
slightly  under  20  kilobits/second  in  case  D. 

in  the  same  figure,  we  have  illustrated  with  x's  the  results 
of  a  detailed  simulation  performed  by  Bolt,  Beranak  and  Newman 
with  a  realistic  routing  and  metering  strategy^  For 

simplicity,  the  simulation  omitted  all  network  overhead  and 
assumed  fixed  lengths  of  1000  bits  for  all  messages.  It  is 
notable  that  the  delay  estimates  from  the  BB..  simulation  (which 
used  a  dynamic  routing  strategy)  and  the  computation  based  on 
the  static  routing  strategy  are  in  close  agreement.  In  particular, 
they  both  accurately  determined  the  vertical  rise  of  the  delay 
curve  in  the  range  just  above  400  kilobits/second,  the  formula 
by  predicting  infinite  delay  and  the  simulation  by  rejecting 
the  further  input  of  traffic.  Furthermore,  the  simulation  did 
not  require  identical  traffic  from  each  IMP  (as  did  the  static 
routing  procedure)  and  therefore  the  curve  could  actually  be 
recomputed  with  a  slightly  skewed  traffic  distribution  for 
even  closer  agreement. 

in  practice  and  from  the  analytic  and  simulation  studies : 
of  the  ARPA  Network,  the  queueing  delay  is  observed  to  remain 
well  within  the  design  constraint  of  0.2  seconds  until  the 


■=»- 


. 


71. 


traffic  wi thin  the  network  approaches  the  capacity  of  a  cutset  . 
The  delay  then  increases  rapidly.  Assuming  that  alternate 
routing  guides  excess  traffic  along  paths  with  excess  capacity, 
no  circuit  will  be  operated  at  full  capacity  for  very  long  until 
thrs  point  is  reached  and  thus  no  sustained  queuing  backup  should 
occur.  Thus,  as  long  as  traffic  is  low  enough  and  the  routing 
adaptive  enough  to  avoid  the  saturation  of  cutsets,  queuing 
delays  will  not  be  significant. 

One  complete  application  of  the  rew  routing  algorithm 
enables  us  to  route  along  shortest  paths  about  as  much  flow 
as  the  subop timal_method  discussed  in  our  Second  Semiannual 
Report.  Thus,  one  may  expect  throughputs  within  5-20%  of  optimal 
and  if  this  is  acceptable  (for  example,  during  optimization) 
there  is  no  need  to  proceed  further.  If,  on  the  other  hand, 
better  results  are  required,  saturated  links  may  be  removed  one 
or  more  at  a  time  and  the  complete  process  repeated.  After  each 
such  iter; cion,  more  traffic  can  be  sent  through  the  network. 

As  an  example,  the  23  node  network  shown  in  Figure  3.2.3  has 
five  saturated  links.  Five  iterations  were  required  to  obtain 
these  flows  before  a  cut  was  removed  and  the  network  was 
disconnected.  The  performance  of  the  network  after  each  itera¬ 
tion  is  plotted  as  throughput  versus  delay  curves  in  Figure  3.2.4. 
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3.3  New  Shortest  Route  Algorithms 


NAC  s  improved  shortest  route  algorithm  consists  of  two  parts: 

a  modified  version  of  Floyd's  algorithm  and  a  node  truncation  step. 

Step  3  of  Section  3.2  represents  a  modified  version  of  Floyd's 

algorithm.  This  version  is  especially  efficient  for,  but  not 

limited  to,  networks  satisfying  the  triangle  inequality.  A  basic 

step  for  the  ordinary  Floyd's  algorithm  is  to  set  d  =  Min  (d- 

i/3  C  i/k 

+  ^k, j '  ^i, j ^  all  k,  i,  j.  This  equation  performs  unnecessary 
additions  and  comparisons  for  those  j's  which  are  directly  adjacent 
to  i,  and  for  those  j's  and  i's  which  do  not  have  a  path  to  k  with 
a  finite  value.  In  our  modification,  we  only  choose  those  j's 
which  do  not  neighbor  i,  and  thereby  savings  on  computation  can 
be  made  for  highly  connected  networks .  Furthermore,  we  only 
choose  i's  and  j's  which  have  a  finite  path  to  k;  thereby  wa 
can  save  computing  time  for  sparsely  connected  networks. 

Steps  1,  2,  4  and  5  in  Section  3.2  represent  the  node 
truncation  part.  The  purpose  of  the  truncation  is  to  reduce 
the  size  of  the  network  being  considered  so  that  computation  can 
be  simplified  when  eithc..  the  ordinary  or  the  modified  Floyd's 
algorithm  is  applied  on  the  remaining  network.  As  already  stated, 
the  node  truncation  technique  is  not  limited  to  nodes  of  degree 
one  and  two  as  long  as  the  savings  on  applying  Floyd's  algorithm 
warrants  the  extra  overhead  involved  in  the  truncation.  For 
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efficient  use  of  the  algorithms,  we  need  to  r.now  at  which 
level  of  node  degrees,  the  node  truncation  approach  is  no 
longer  advantageous.  We  will  discuss  two  cases. 

The  General  Case 

In  this  case  link  costs  (lengths)  .  ~.y  assume  any  value  as 
long  as  there  is  no  circuit  whose  sum  of  costs  is  negative. 
Symmetry  of  the  link  cost  matrix  is  not  necessary. 

Let  NN  be  the  number  of  nodes  in  the  network  and  D  the 
degree  of  the  node  to  be  truncated.  The  number  of  additions 
and  comparisons  required  at  the  time  the  node  is  removed  from 
the  net  is  equal  to  D(D-l).  The  number  of  additions  and  com¬ 
parisons  required  at  the  time  the  node  is  returned  to  the  net 
is  2 (D-l)  (NN-1) .  The  total  number  of  additions  and  comparisons 
required  for  the  node  truncation  is  therefore  equal  to  (D-l) • 

(2NN  .+  D-2).  The  number  of  additions  and  comparisons  saved  if 
Floyd's  algorithm  is  then  applied  to  the  remaining  net  is 
NN (NN-1)  (NN-2)  -  (NN-1)  (NN-2)  (NN-3)  =  3 (NN-1)  (NN-2) . 

Therefore,  the  net  saving  on  the  number  of  additions  and  com¬ 
parisons  is:  3(  NN-1)  (NN-2)  -  (D-l)  (2NN-D  -  2).  This  number  is 

i 

positive  for  D<NN-1  and  zero  if  D^NN-l.  Therefore,  except  for  the 
limiting  case  of  a  completely  connected  net,  the  node  truncation 
technique  is  always  faster  than  Floyd's  method.  The  algorithm 


for  handling  the  general  case  is  given  below. 


(1)  GENERAL  NODE  TRUNCATION  SHORTEST  PATH  ALGORITHM 
Step  0.  Let  K  =  1. 


1.2 


Let 


Step  2 

2.1 


Step  1.  Removal  of  pendant  nodes 

1-1  If  there  are  no  degree  one  nodes,  go  to  Step  2. 

Pick  any  degree  one  node  and  renumber  it  as  v 

K 

its  adjacent  node,  and  reduce  the  degree  of  Bv 

K 

by  one.  Let  K  *  K+l  and  go  to  1.1. 

Removal  of  nodes  with  degree  greater  than  one. 

Rename  the  remaining  nodes  as  v^,  v^^,  ...,  vK 
such  that  their  degrees  Dnn  £  .  ..£DK.  Let  H  =  NN-K+1. 
Let  Bk  =  |k1#  K2,  ...,  K q(K)j  be  the  sets  of  nodes 
adjacent  to  vK  in  the  remaining  network,  where  q(K)  =  Min 
(dr,  h-i}. 

For  i,j  -  1,  2,  ...  q(K),  set 

VKj  ■  Minl\.Ky  VK  *  dvK.K.  } 

.  ^i-Xj  =  {PKi'Kj  if  dKi<Kj  4  \,vK  * 


2.2 


2.3 


■K.  ,v 


i'vK 


otherwise 


V.  “  +  ^  Ki  is  not.  directed  to  K- 

i  j 


K 


j  “  DK++  1  if  Kj  is  not  directed  to  K£ 


Kl'  K2,  ...,  are  considered  to  be  adjacent  to  each 


other . 
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If  H  -  2,  go  to  Step  3.  Otherwise  let  H  =  H- 
K  =  K+l,  and  go  to  2.2. 


Step  3. 
3.1 


Labeling 


For  j 

=  K+l, 

• • • t  NN $  set 

d  • 

=  Min 

[d:,Ki  + 

3'VK 

KiCBK 

Pj,vK 

■  pj.h 

where  h  satisfies 

dvK,j 

II 

|dvK.Ki  +  dKto} 

PvK'i 

where  r  satisfies 

( 


1  and 


dh,vK 


+  dr,j 


3.2 


If  K  -  1,  Stop.  Otherwise,  let  K  =  K-l  and  go  to  3.1 


sPccial  Case-~ - Symmetry  and  triangle  inequality  are  satisfied. 

It  can  be  shown  that  regardless  of  the  exact  degree  of  any  node 
the  node  truncation  approach  is  always  faster  than  the  ordinary 
Floyd's  algorithm.  However,  the  modified  version  described  earlier 
of  Fioyd's  algorithm  may  be  faster  for  nodes  with  large  degrees. 

The  exact  values  depend  on  th-  topology  of  the  network,  and  there 
is  no  simple  formula  to  determine  the  breakpoint.  We  evaluate  the 
tradeoffs  between  the  two  approaches_as^ollov/s .  We  calculate  a 
node  degree  DT  such  that  if  D<DT  where  D  is  the  degree  of  any  node 
during  the  labeling  process,  then  it  is  computationally  more  effi¬ 
cient  to  remove  the  node  via  truncation  than  to  consider  the  node 
during  labeling  by  the  revised  Floyd's  algorithm. 

Assume  that  the  modified  Floyd's  algorithm  is  to  be  applied  on 
the  network  remaining  after  node  k  is  removed.  Let  DCi  be  the 
number  of  nodes  not  adjacent  to  node  i  in  the  starting  network. 

Let  D  be  the  degree  of  node  k  and  let 

NN 

TCD  =  T*  CD,. 
i-1 

The  net  saving  on  the  number  of  additions  and  comparisons  is  more 
than 

*s[TCD(NN-2)  -  (TCD-2CD^)  (NN-d)  ]  -  J5  (D-l)  (2NN+D-  2) 

*  ^TCm^CD*  (NN  *3)J-  -  ij(D  -1)  (2NN+  D-2) 

*  CDk(NN-3)  -  Jj  (D-l)  (2NNfD-2) 

£  (NN-3 )  (NN-crl)  -  3j(d-1)  (2NN+D-2) 

v 

e  h (“D  -  (4NN-7)  D+2 (NN-1) > 0  for  D  < .42  NN 


Therefore,  foi  any  D<. 42  NN  it  is  always  better  to  use  trunca¬ 
tion  For  the  special  case  being  considered  (i.e.  a  symmetric 
distance  matrix  which  satisfies  the  triangle  inequality)  the  algorithm 
may  be  stated  as  given  below. 


(2)  SPECIAL  NODE  TRUNCATION  SHORTEST  PATH  ALGORITHM 
Step  0.  Same  as  in  general  case. 

Step  1.  Same  as  in  general  case. 

Step  2. 


2.1 

2.2 

2.3 


Same  as  in  general  case. 

If  D>  0.42  NN,  go  to  Step  3. 

Let  Bk  =  K^,  K2,  ...,  kd  be  the  sets  of  nodes  adjacent 

X\ 

to  vK  in  the  remaining  network.  Let  E  be  a  subset  of  B 

K 

which  contains  nodes  adjacent  to  v^  in  the  starting  network. 
For  i=l,  2,  Dk  -  1  and  j  •  i+1,  ...,  dr  set 

\,K  .  "  %  Ki  ■  ^K..Kj,  dK.<VK  +  dVR  <KJ 


;PRi'Kj  if  SdKi'vK  +  VKJ 


PKi'K: 


Pv  „  otherwise. 
Ki'vK 


PKj'Ki 


Pr  ,K.  ^  K  ^  v  + 

j  '1  Ki'Kj  Kj'vK  V 


K, 


’  PT,  otherwise 

Kj'VK 


*  DKj  ”  dk.  +  1  if  Kj_  and  Kj  are 


not  adjacent  nodes. 


Kl'  k2'  ***'  kD  are  considered  to  be  adjacent  to  each 
K 

other  in  the  remaining  network. 
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2.4 


Let  H  =  H  -  1  and  K  =  K+l.  'if  H  =  2,  go  to  Step  3. 
Otherwise,  go  to  2.2. 


Step  3. 
3.0 

3.1 

3.2 


Let  Q  -  vnn_jl,  ...,  vK|  ,  N*  = 

Same  as  in  Section  3.2. 


Same  as  in  Section  3.2 


NN-K-i-1 


Step  4. 

4.0 

4.1 


Labeling 
K  -  K-l 

For  any  j£  [k+1,  . 


d  .  =  d 

3,Vk  vk,3 


set 


i  •  /  n|  s  , 


Pj.vK  Pj,h  f  PvK.j  «V„,h  . 


K' 


where  h  satisfies  =  d  •  .  +  d-u 

3*vk  aj,h  ^  ah,vK 


4.2  If  K-l,  Stop.  Otherwise,  let  K  =  K-l  and  go  to 


go  to  Step  4.1. 


Even  though  we  have  only  considered  the  shortest  path 
problems  for  all  node  pairs,  the  node  truncation  techniques  can 

also  be  used  to  determine  shortest  paths  between  specified  pairs 
of  nodes. 
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Let  H  =  H  -  1  and  K  =  K+l.  If  H  =  2,  go  to  Step  3, 
Otherwise,  go  to  2.2. 


Step  3. 


Let  Q  =  (vjjj,,  vNN_1#  ...,  vK|  ,  N'  =  NN-K+1 


Same  as  in  Section  3.2. 


Same  as  in  Section  3.2, 


Step  4.  Labe line 


K  =  K-l 


For  any  j£  [k+1,  . ..,  nJ  =  ek  >  set 


d .  =  d  .  =  Min 

U,vK  vK,  3  KiCBK 


{dj,Ki  +  dK.'  vk) 


Pj^VK  ^3/h  PVvO  • 


where  h  satisfies  d.,  =  .  +  dv  „ 

D,vk  3/h  h,vK 


If  K*l,  Stop.  Otherwise,  let  K  =  K-l  and  go  to  Step  4.1. 


Even  though  we  have  only  considered  the  shortest  path 
problems  for  all  node  pairs,  the  node  truncation  techniques  can 
also  be  used  to  determine  shortest  paths  between  specified  pairs 
of  nodes. 


.3.4  Computational  Comparisons 


The  ordinary  Floyd's  algorithm,  NAC's  shortest  route  algorithm, 
and  traffic  assignment  algorithm  h.ve  been  applied  to  various  10 
node,  20  node,  3C  node,  40  node,  and  80  node  networks.  The  computing 
times  are  recorded  and  are  listed  on  Table  3.4.1.  ARPA-like  and  ARPA 
networks  for  these  experiments  are  shown  on  Figure  3.4.1,  Figure  3.4.2 
Figure  3.4.3  and  Figure  2.1.2(g).  M:  -imum  spanning  trees  are  based 
on  ARPA  nodes  and  are  given  on  Figure  3.4.4  to  Figure  3.4.7.  Minimum 
link  x-connected  graphs  [1]  are  those  that  are  x-connected  and 
are  constructed  with  minimum  number  of  links.  (a  graph  is  x-connected 
if  it  requires  the  removal  of  at  least  x  nodes  to  disconnect  it). 
Minimum  link  2,  3,  4  and  5  connected  10-node  graphs  are  shown  on 
Figure  3.4.8.  Those  with  more  nodes  are  formed  in  a  similar  way. 

Data  :r°m  Table  3*4*1  are  ^aphed  as  a  function  of  computing  time 
versus  number  of  nodes  in  Figure  3.4. S.  These  curves  clearly  indi¬ 
cate  that  comput  .tional  complexity  is  proportional  to  NN3  for 
ordinary  Floyd's  algorithm  regardless  of  the  topology  and  is  propor¬ 
tional  to  NN2  for  NAC's  algorithm  when  apnlied  to  telecommunication 
networks (i.e. tree  structures,  ARPA-like  networks,  2-connected  networks, 
etc.), and  is  proportional  to  NN2  for  traffic  assignment.  For  moderate  (most 
nodes  with  degrees  higher  than  2)  and  high  connected  networks, .the  node 
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truncation  part  is  not  used  in  these  figures  since  it 
not  felt  that  programing  this  general  algorithm  would  be 
immediately  necessary  for  our  ASPA  net  studies.  The  NAC 
modified  version  of  Floyd's  algorithm',  even  when  used  alone 
outperforms  the  ordinary  one.  especially  for  highly  connected 
nets.  The  main  advantage  the  modified  version  has  over' the 
ordinary  one  is  its  use  of  the  triangle  inequality,  otherwise, 
its  efficiency  would  not  be  very  much  better  than  that  of  the 
original  Floyd's  algorithm.  Second,  since  the  NAC  algorithm 
requires  larger  overhead,  the  larger  the  net,  the  better 
efficiency  the  NAC  algorithm  shows.  As  can  be  observed  from 
Pig.  3.4.7  for  some  10  node  nets,  NAC's  algorithm  may  even 
be  less  efficient  due  to  the  overhead.  (The  lower  ends  of  the 
curves  are  not  quite  proportional  to  NN2  or  N3  rules  because- 
of  overhead  factors  which  are  significant  when  the  net  is  small.) 


TABLE  3.4.1 


path  ^Gosiaas 

(In  Milliseconds) 


Network 


ARPA  Net (Fig.  3.4.1) 

Minimum  Spanning  Tree (Fig. 3 .4.4 ) 
Minimum  Link  2-connected 

3-  connected 

4- connected 

5- connected 
8-conneoted 


_ _ Label  Process 

_F_lcvd-s  Algo.rNAC's  Alan 


10  Minimum  Link 
Nodes  Minimum  Link 
Minimum  Link 
Minimum  Link 


30 
Nodes 


ARPA  Net  (Fig.  3.4.2) 

Minimum  Spanning  Tree (Fig. 3 . 4 . 5 ) 
Minimum  Link  2-connected 

20  Minimum  Link  3-connected 

Nodes  Minimum  Link  4-connected 

Minimum  Link  5-connected 

Minimum  Link  18-connected 

ARPA  Net  (Fig.  3.4.3) 

Minimum  Spanning  Tree (Fig. 3.4. 6) 
Minimum  Link  2-connected 
Minimum  Link  3-connected 
Minimum  Link  4-connected 
Minimum  Link  5-connected 
Minimum  Link  28-connected 

ARPA  Net  (Fig. 2.1.2 (h)  ) 

Minimum  Spanning  Tree (Fig.  3.4.7) 
Minimum  Link  2-connected 
Minimum  link  3-connected 
Minimum  Link  4-connected 
Minimum  Link  5-connect»d 
Minimum  Link  38-connected 

Minimum  Link  2-connected 
Minimum  Link  4-connected 
Minimum  Link  10-connected 
Minimum  Link  40-connected 
Minimum  Link  73-connected 


4C 

-Nodes 


80 

Nodes 


.010 
.010 
.010 
.010 

.009 
.009 
.010 

.064 
.  062 
.063 
.064 
.063 
.062 
.063 

.211 

.209 

.209 

.211 

.210 

.212 

.208 

.501 

.510 

.501 

.511 

.508 

.508 

.501 

<  .075 
3.975 
3.968 
4.020 
4.097 


.008 

.002 

.007 

.011 

.010 

.011 

.009 

.020 

.008 

.018 

.052 

.045 

.056 

.031 

.034 

.015 

.033 

.142 

.131 

.160 

.063 

.05  7 
.028 
.056 
.298 
.276 
.334 
.102 


.224 

2.141 

2.329 

2.359 

.467 


Traffi 

Assicrnm 


.007 

.008 

.008 

.008 

.008 

.007 

.007 

.023 

.025 

.024 

.025 

.023 

.023 

.019 

.055 

.055 

.057 

.056 

.054 

.054 

.040 

.098 
.100 
.102 
.099 
.097 
‘.095 
.070 

.380 
.388 
.377 
.341 
.293 
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Minimum  Link  2  Connected 


Minimum  Link  3  Connected 


Minimum  Link  4  Connected 


Minimum  Link  5  Connected 


10  NODE  NETS 


tfACU  Algorithm 
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FIGURE  3.4.9 
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RELIABILITY  OF  LARGE  COMPUTER  NETWORKS 


4.1  I N TROD UCT  TOM 

Spurred  by  the  early  successes  of  the  ARPA  Computer  Networ) . 
and  the  economic  potential  of  such  nets,  the  size  of  computer 
networks  can  be  expected  to  increase  rapidly,  increased  numbers 
of  computers  in  a  computer  network  give  rise  to  several  questions 
about  its  reliability.  For  the  ARPA  net  the  principal  reliability 
requirement  for  smaller  network  designs  (of  less  than  30  or  40  nodes) 
is  that  there  exist  two  node  disjoint  paths  between  every  pair  of 
nodes  in  the  net.  This  guarantees  that  at  least  t,  nodes  or  links 
must  fail  before  any  two  nodes  cannot  communicate  with  one  another. 
More  detailed  reliability  analysis  of  networks  designed  in  this  way 
indicated  that  this  approach  does  in  fact  guarantee  sufficient  re¬ 
liability  for  the  network  taken  as  a  whole  for  nets  similar  to  the 
current  ARPA  net.  The  first  question  of  interest  is:  does  the 
two  node  disjoint  path  method  suffice  as  the  number  of  nodes  grows. 
Closely  related  to  this  question  is :  \*at  mintaun  arount  of  network  invest¬ 


ment  is  required  as  the  number  of  nodes  increases  in  order  to  main¬ 
tain  a  given  level  of  network  reliability,  in  the  next  section ' 
results  bearing  on  these  questions  are  given,  simply  stated,  it 
does  not  appear  that  network  reliability  constraints  can  be  met  for 


very  large  nets  simply  by  requiring  two  node  disjoint  paths  between 
each  pair.  More  sophisticated  techniques  for  designing  large  nets 
will  be  required.  Such  techniques  are  currently  under  investigation. 

For  many  reasons  it  seems  imperative  that  large  omputer  nets 
will  exhibit  some  hierarchical  or  decomposed  structure.  In  Section 
4.3  the  computational  consequences  for  reliability  analysis  of  a 
two  level  hierarchal  approach  is  investigated  in  which  the  nodes 
are  partitioned  into  subnetworks  called -regions"  interconnected  by 
a  "global"  network.  In  the  same  section,  the  related  question  of 
what  size  regions  yields  minimum  computation  for  analysis  is  explored. 

Finally,  to  make  reliability  analysis  of  large  networks  feasible, 
computational  improvements  over  the  techniques  employed  for  the 
smaller  networks  must  be  developed.  A  detailed  analysis  of  the 
growth  of  computation  with  network  size  for  various  reliability 
analysis  techniques  is  found  in  Section  4.4,  and  new  techniques 
which  are  much  faster  than  previously  known  techniques  are  specified. 

2  • - NETWORK  _reli ability  as  A  FUNCTION  OF  STEF 

Low  cost  computer  network  designs  for  the  ARPA  Network  have  v.p 
to  now  been  made  under  the  reliability  constraint  that  two  node  * 
disjoint  paths  exist  between  every  pair  of  nodes.  For  networks  up 

to  30  or  40  nodes  this  criterion  yields  networks  which  are-very 

- 
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resistant  to  failures  of  their  components.  For  example,  for  the  23 
*^®ie  link  ARP  A  Net,  over  95%  of  all  node  pairs  are  able  to  coromuni— 
ca-e,  on  the  average,  if  the  nodes  and  links  are  down  2%  of  the 
time. 

To  measure  how  adequately  this  design  technique  maintained 
network  reliability  as  the  number  of  nodes  in  the  network  increased, 
low  cost  networks  with  20,  40,  60,  80,  100  and  200  nodes  respectively 
were  designed  using  NAC's  network  design  program  with  the  reliability 
constraint  of  two  node  disjoint  paths..  The  results  are  shown  in 
Figure  4.2.1. 

As  measured  by  the  fraction  of  node  pairs  not  communicating, 
the  reliability  actually  increased  with  the  number  of  nodes  up  to 
60  nodes  at  which  point  the  reliability  decreased  w:.th  the  number 
of  nodes.  Thus,  at  least  for  this  series  of  networks,  reliability 
will  he  degraded  as  the  number  of  nodes  increase* above  60. 

Another  indication  of  the  dependence  of  network  reliability 
on  the  number  of  nodes  is  a  result  of  Gelmans  [1967].  if  we  con¬ 
sider  nets  in  which  only  the  links  fail  and  take  as  our  measure  of 
reliability  the  probability  that  vhe  net  will  be  connected,  Gelmans 

found  that  the  number  of  links  must  increase  at  least  as  fast  as’ 

NN  In  NN 

2  I  in  pj  w«ere  NN  is  the  number  of  nodes  and  p  is  the  probability  of 
link  failure  in  order  that  the  probability  of  network  failure  not 
approach  1.  Since  a  2  connected  net  has  on  the  order  of  NN  links 
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the  behavior  of  the  term  (In  HN,/2jl„  p|  implies  that  as  m  ^ 
the  point  where  NN  -  1/p*.  2  connectivity- win  no  ionger  patentee 
"sufficient"  reiiahiuty.  For  example.  if  both  nodes  ana  links  faiX 
With  probability  0.02.  an  approximate  analysis  with  only  link  fail¬ 
ures  woula  indicate  2  connect  because  inaaequate  S*  »  ,**oaching  i00 
These  fo  results  while  not  aefinitive  inaicate  strongly 
that  tore  sophisticatea  methods  of  maintaing  reliability  for  the 
aesigns  of  a  larger  networks  must  be  aevelopea. 


COMPUTATIONAL  of  „„ - - 

We  consiaer  a  two  level  hierarchical  decomposition  of  networks, 
rhe  noaes  are  divided  into  groups  callea  regions.  Modes  which 
are  ena  noaes  of  links  connecting  two  regions  are  callea  central 
noaes.  a  regional  subnetwork  or  a  local  network  is  the  nodes  of  a 
region  together  with  the  links  which  connect  two  nodes  in  the 
region,  such  a  decomposition  may  result  from  the  necessity  of 
reducing  the  analysis  or  design  procedures  to  manageable  size  or 
it  may  be  inherent  in  the  structure  of  the  network  itself.  For 
example,  the  routing  procedure  may  require  tables  which  are  limited 
in  size  or  the  load  on  the  network  may  be  such  that  traffic  within 
certain  groups  of  nodes  is  much  heavier  than  traffic  between  the 
groups ;  this  leads  naturally  in  both  cases  to  hierarchical  networks. 


'  / 


One  of  the  first  questions  that  arises  is  how  large  to  make 
the  regions  and  how  many  res.ons  ^  Qne  u  ^ 

atter.pt  to  minimize  the  computational  requirements  for  the  design 
procedure.  Suppose  we  have  a  procedure  to  perform  on  a  network 
for  Which  the  computing  time  can  he  characterized  as  a  polynomial 
function  of  the  number  of  nodes,  iwo  examples  are  the  NAc  network 
design  algorithms  and  some  of  the  NAC  reliability  analysis  programs. 

Suppose  further  that  the  procedure  can  be  carried  out  by  per¬ 
forming  the  procedure  separately  on  each  region  of  our  decomposed 
network  and  then  performing  the  procedure  once  on  the  globcl  „et- 

NG  the  number  of  central  nodes  per  region  in  the  global  network. 
We  assume  that  the  number  of  nodes  is  the  same  for  each  region  as 
is  the  number  of  central  nodes  and  that  the  computing  time  for  a 
subnetwork  with  n  nodes  is  proportional  to  nv  for  some  v  >  i.  mile 

these  assumptions  are  not  usually  exactly  valid,  the  conclusions 

based  on  them  are  indicative  and  v  • 

naicative  and  the  techniques  used  can  also  be 

applied  to  more  general  cases. 

% 

under  these  assumptions  the  total  computation  time  is  propor- 


tional  to 


T  *  NR  +  (NR  •  NG)V  , 


where  the  first  term  corresponds  to  the  regional  calculation  and 
the  last  term  to  the  global  calculation.  Assuming  that  NR  and 
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m/m),  the  number  of  no.es  per  region,  can  take  on  non-integer 
values  we  can  determine  the  number  of  regions  which  corresponds  to 

minimum  computer  time  by  setting  _i£_  to  zero 

^  NR 


d(NR)*  ^  (1"V  J  (NR)"V  +  V  (NR)  V_1  NGV  = 


implies 


HR  -  <^->z£r 


The  assymptotic  result  as  v- 


00  is  of  interest 


i  •  v  1 

lim  /  NN  . Yv-l  ,v_i  2v~-T 
v-**  °“  NG  ;  {‘~~Z  > 


This  result  can  also  be  obtained  by  noticing  that  for  v  large  t  is 

dominated  by  the  subnetwork  with  the  largest  number  of  nodes;  it 

ia  then  easy  to  convince  oneself  that  the  minimum  computation  will 

occur  when  the  global  network  has  exactly  as  many  nodes  as  the 

regions;  i.e.,  when  NR  •  NG  =  nn/nr  .  solving  this  for  NR  yields 

NR  ~/mm.  in  Table  4.3.1  the  optimal  number  of  regions  is  given 

to  the  nearest  integer  for  v  .  2,  3.  4,  5,  6.  »  and  for  NN  -  20. 

40.  60.  80.  100.  200,  400.  600.  800,  1000.  NG  was  taken  to  be  2 
in  all  cases. 

Reliability  analysis  of  decomposed  networks  can  be  carried 
°Ut  “  4  8 trai?tt forward  way.  The  basic  step  in  reUability 


analysis  is  the  determination  of  the  number  and  size  of  components 
in  a  graph.  First,  let  us  review  the  technique  for  networks  with¬ 
out  decomposition  (see  the  Thir^  Semiannual  Report) . 


Algorithm  1. 

Step  0:  (Initialization).  Start  with  AQ  •  0  and  associate  with— 
node  i  a  component  label  i.  Set  the  number  of  elements 
in  each  of  the  NN  components  to  1.  Set  k  -  0  and  go  to 
Step  1. 

Step  1*  (New  Link).  Add  a  link  ak  =  (mk,  nk)  to  **k  to  form  Ak+^. 

If  there  are  no  remaining  links  ;i.e.  ,Ak=A,  stop.  Otherwise 
examine  the  labels  of  mk  and  nk.  If  they  are  the  same9 
repeat  Step  1  with  k:  =  k+1.  If  not,  go  to  Step  2. 

Step  2:  (Join  Components).  Change  all  the  node  labels  which  are 
the  same  as  the  label  of  mk  (including  mk's  label)  to 
the  label  of  nk.  Set  the  number  of  elements  in  the  com¬ 
ponent  corresponding  to  nk  to  the  sum  of  the  component 
sizes  previously  corresponding  to  mk  and  nk.  Set  k:  =  k+1; 
go  to  Step  1. 

The  computation  for  this  algorithm  in  the  naive  form  given 

here  is  dominated  by  the  relabeling  in  Step  2  which  in  total  involves 

2 

on  the  order  of  NN  operations.  (A  detailed  analysis  and  more 

efficient  variants  of  this  algorithm  are  discussed  in  the  next  section) 
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To  use  this  algorithm  on  a  decomposed  network  the  algorithm 
is  first  applied  to  each  region  separately.  Then  the  algorithm 
is  applied  to  the  global  network  with  the  following  simple  modifi¬ 
cations  to  the  Initialization  Step  0.  Each  global  node  is  given 
an  initial  node  label  which  is  a  pair  consisting  of  its  region 
number  and  the  component  number  it  ended  up  with  in  the  regional 
analysis.  The  number  of  elements  in  the  component  pairs  is  the 
number  of  elements  in  the  components  resulting  from  the  regional 
analysis.  With  this  initialization  the  algorithm  procedes  as  before 
For  example,  if  NG=2,  NN=  200,  the  minimum  computation  (see 
Table  4.3 . 1) would  occur  when  the  number  of  regions  is  17. 

To  test  out  the  decomposition  approach  to  network  reliability 
analysis  a  new  computer  program  was  written.  By  making  extensive 
use  of  list  data  structures  decomposed  networks  with  arbitrary 
numbers  of  regions  and  arbitrary  size  of  global  networks  can  be 
handled.  The  examples  described  in  Section  2  were  run  using  the 
program. 

4.4  FAST  ALGORITHMS  FOR  COMPUTING  COMPONENTS  OF  SPARSE  NETWORKS 

In  our  previous  work  on  reliability  analysis  of  networks,  three 
approaches  were  introduced,  in  this  section  we  examine  in  some 
detail  relative  computational  merits  of  these  methods.  The  basic 


problem  is:  given  a  network  with  NN  nodes  and  NB  links  where  each 
link  has  probability  p  of  failing,  we  wish  to  estimate  h(p),  the 
probability  of  the  network  being  disconnected  by  the  failing  links, 
or  to  estimate  n(p),  the  expected  number  of  node  pairs  not  able  to 
communicate  for  NP  values  of  p.  The  first  approach  which  we  shall 

call  the  naive  approach  is  to  first  generate  a  random  number  for 

/ 

each  link.  If  the  number  is  less  than  p,  the  corresponding  link 
is  considered  failed  and  removed  from  the  net;  otherwise  the  link 
is  left  in.  Then  the  resulting  network  is  checked  for  connectivity 
o.i.  the  number  of  node  pairs  disconnected  depending  on  whether 
h (p)  or  n (p)  is  desired.  This  computation  is  repeated  enough 
times  until  a  sufficiently  accurate  estimate  is  obtained  according 
to  the  usual  standards  of  Monte  Carlo  simulation.  This  entire 
procedure  must  then  be  repeated  for  each  of  the  NP  values  of  p  of.. 
interest. 

The  second  approach  which  we  will  call  the  functional  simulation 
approach  is  based  on  a  technique  used  for  simulation  approaches  to 
percolation  problems.  Here  as  in  the  naive  method,  a  random  number 
is  generated  for  each  link.  Now  however,  we  order  these  numbers 
and  their  corresponding  links  in  decreasing  order.  If  r^  is  the* 
random  number  generated  for  the  ith  link  suppose  ' 

t  r.  #  •••#  r* 
x2  XNB 

are  the  random  numbers  in  decreasing  order.  Then  in  the  naive 
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method  if  rik>  P  >  rik+1'  we  would  analyze  for  connectivity  the 
subnetwork  consisting  of  the  links  i1#  i2,  ....  ±k,  We  can 

evaluate  one  point  in  the  sample  for  each  value  of  p  for  one  set 

of  random  numbers  using  the  following  procedure:  for  l£p>r- 

al 

the  network  has  no  links  for  r^  Z’-p  >  r^  the  network  consists  of 
the  linki-L  only  for  r^  >  p  >r  ±  the  network  consists  of  links  12 
and  i^  etc.  What  makes  this  technique  especially  effective  is 
that  there  exist  connectivity  algorithms  which  analyze  the  network 
one  link  at  a  time  with  the  links  in  arbitrary  order.  Thus,  if 
the  network  with  all  the  links  present  is  analyzed  for  connectivity, 
introducing  the  links  in  the  order  i1#  i2,  i^B  using  one  of 

these  techniques,  we  achieve  the  analysis  for  the  subnetworks 
consisting  of  ip  i2,  ...,  ik  for  k  =  1,  . . .,  nb.  Thus  in  parti¬ 
cular  we  can  determine  h(p)  or  n(p)  for  all  NP  values  of  p  at  once 
using  a  connectivity  algorithm  once  for  each  sample  point  rather 
-han  NP  times  as  would  be  required  in  the  naive  method.  If  only 
h(p)  is  required,  the  computation  simplifies  even  further,  then 
for  a  given  sample  point  the  only  quantity  of  interest  is  the 
smallest  k  for  which  i^,  i2,  ...,  ik  is  connected.  Then,  for  all 

P>ri  the  net  is  disconnected  and  for  all  p  $r-  the  net  is 
.  K  xk 

connected. 

By  a  theorem  due  to  Kruskal f 1956]  each  connectivity  calcu^a- 
Uon  is  equivalent  to  determining  a  maximum  total  length  spanning 
forest  where  the  length  of  a  link  i  is  r;.  This  relation  is  dis¬ 
cussed  in  detail  in  a  forthcoming  paper  by  Korshenbaum  and  Van 
Slyke. [1972] . 


The  final  technique  which  we  call  the  Moore-Shannon  approach 


is  based  on  the  use  of  the  equation 


(1) 


NS^ 

h(P) 

k=  0 


C(k)  p^-^  qk 


where  C(k)  is  the  number  of  disconnected  subnetworks  with  exactly 
k  links.  This  relation  is  siiftilar  to  one  due  to  Moore  and 
Shannon  [1956]  for  analyzing  the  reliability  of  switching  networks. 

A  similar  relation  can  be  used  for  n(p): 

NB 

(5)  n(p)  =  ^  ^D(k)  pNB""k  qk 


where  D(k)  is  the  average  number  of  node  pairs  not  communicating 
over  all  subnetworks  with  exactly  k  links .  In  this  approach  each 
C(k)  or  D(k)  is  estimated  by  simulation  rather  than  attempting  to 
directly  estimate  the  sums  h(p)  or  n(p).  As  was  shown  in  the  Third 
Semi-annual  Report,  this  is  especially  effective  in  (1)  because  all 
but  NB-NN+2  of  the  C(k)  are  known  a  priori.  There  are  (^®)  sub¬ 
networks  with  exactly  k  links.  If  this  number  is  reasonably  small, 
C(k)  and  D(k)  can  be  calculated  by  enumeration,  and  if  the  number 
is  too  large  they  can  be  estimated  by  simulation.  In  either  case 
it  is  useful  to  use  a  connectivity  algorithm  whicrh,  after  the 

i 

connectivity  of  one  subnetwork  is  determined,  subnetworks  similar 

. .  mf 

■  ’  c  .  <  ^ ' 

..  ~T  .••a  '4m  ii*  T  i  •  iU.  -  *  ■*. 
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to  the  first  can  be  easily  analyzed  using'  the  results  of  the  first 
analysis.  Such  an  algorithm  was  described  in  the  Third  Report. 

We  now  introduce  several  useful  connectivi  .y  algorithms  and 
analyze  the  computation  required  for  each  one.  Before  we  begin, 
we  note  that  for  network  which  is  nearly  complete,  any  connectivity 
algorithm  will  require  at  least  a  number  of  calculations  on  the 
order  of  NN2  since  each  link  must  be  examined  and  there  are  , 

(NN)  •  (NN-l)/2  possible  links. 

For  the  first  algorithm  we  use  the  node  adjacency  representation 
of  the  network.  Two  nodes  are  adjacent  if  they  are  the  endpoints 
of  a  link  in  the  network.  The  node  adjacency  representation  con¬ 
sists  of  specifying  for  each  node,  the  nodes  which  are  adjacent  to 
it.  There  are  two  such  entries  for  each  link  (i, j)  >  one  for  i  being 

•  ’  v  .  ■ 

adjacent  to  j  and  one  for  j  being  adjacent  to  i. 

Algorithm  2 : 

Step  0:  (Initialization)  Set  i=l,  j=l,  k=l,  S=0»  Label  node  i*l 
with  component  label  j=l.  Go  to  Step  1. 

(Look  at  new  link).  Find  the  next  node  i'  which  is  adjacent 
to  i;  if  there  are  none,  go  to  Step  3..  If  node  i*  is  not 
already  in  a  component,  go  to  Step  2.  If  the  node  i'  is 
already  labeled  with  a  component  inmber,  repeat  Step  1. 


Step  Is 


Step  2,  (Add  a  node  to  the  current  component)  Label  the  node  i‘ 
with  the  current  component  label  j  and  add  the  index  of 
the  labeled  node  to  the  stack  S.  Return  to  Step  1. 

Step  3s  (scan  a  new  node).  Remove  a  node  index  i"  from  S  and 

set  i  equal  to  i".  Go  to  Step  1.  if  S  is  empty,  go  to 
Step  4. 

Step  4:  (current  component  complete-start  a  new  one)  Set  k:=k+l 
if  k>NN  we  are  done;  otherwise,  if  node  k  is  unlabeled, 
set  i  equal  to  k  and  set  j:=  j+1.  Go  to  Step  1.  if  rode 
k  is  labeled, repeat  Step  4. 

Algorithm  2  is  close  to  being  the  most  efficient  algorithm 
possible  for  determining  the  components  of  a  graph,  it  has  the 
disadvantage  that  the  links  cannot  be  introduced  in  an  arbitrary 
order.  Thus  this  method  is  only  appropriate  for  the  naive  approach 
to  reliability  analysis.  To  estimate  the  order  of  the  computation 
involved  we  note  that  Step  1  is  performed  exactly  2-NB  times  (since 
each  link  appears  twice  in  the  node  adjacency  representation). 

Step  4  is  repeated  exactly  NN  times  and  Steps  2  and  3  are  performed 

NN-NC  times  where  NC  is  the  number  of  components.  Thus,  the  number 

• 

of  computations  is  the  sum  of  a  term  linear  in  NB  and  a  term  linear 
in  NN.  Since  to  determine  the  components  of  a  graph  we  must,  in 
general,  look  at  all  the  links  and  label  all  the  nodes,  no  algorithm 
can  be  much  faster  for  determining  the  components  of  a  graph. 
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A 


Next,  we  consider  several 


variations  of  Algorithm  1  which  was 


described  in  Section  4.3. 


As  indicated  in  that  section,  the 


dominant  torm  in  the  number  of  operations  for  Algorithm  1  arose 

from  step  2,  the  relabeling,  and  was  on  the  order  of  UK2.  step  2 

occurs  when  a  link  joining  two,  up  to  now,  disjoint  component,  i. 

encountered.  In  Algorithm  1  the  component  labels  of  the  first 

component  were  all  changed  to  those  of  the  second  component.  If 

instead  the  number  of  elements  of  each  component  are  maintained 

and  the  labels  on  the  smallest  component  are  changed,  the  order 

of  the  number  of  operations  is  NN  log2  nn  rather  than  nn2.  To 

prove  this,  let  f(n)  be  the  maximum  number  of  node  relabelings 

required  for  any  net  with  n  nodes  using  the  modified  version  of 

Algorithm  1.  Then  we  have  the  following  recurrence  relation  for 
f  (r.)  t 

\ 

f(n)  =  Max  .  \ 

(2)  l<k<[n/2]  lf<k)  +  +  kj 

Where  k  is  integer  and  [n/2j  is  the  greatest  integer  less  than  or 
equal  to  n/2. 


Theorem 


^  monotone  increasing 
(ii)  £(2*)  mil1'1 


Lemma 


f(jc)  -  JL  log2  x  for  X>Q  satiafies 


(3) 


f(y)  =  Hex 

l=x^y/2 


{f(x) 


+  f(y-x)  +  xj  for  y^l, 


^oof:  Let  g(x;  y,  -(x/2)  log2x  +  ( (y-x/2)  log,  (y-x)  +  x. 


Then 


—J  9(x;  y)  . 
dx2 


utr  >  0  for  x  <  y- 


Thus  g(x;y)  is  convex  upward  on  fl  v/?l  ari/a  v 

^  ra  on  U*  y/2]  and  hence  achieves  its 

maximum  in  x  at  either  1  or  y/2. 

g(l;  y).  <<y-l>/2)  log2  (y-1)  +  1  <  (y/2)  log2y.  g(y/J. .  yJ  . 

Tnus  the  maximum  is  achieved  at  x  *  y/2  and 


t  ,  •  ' 


Max  g  (y 


;  x)  =  f(y)  *  (y/2)  log2  y. 


Proof:  (of  Theorem)  <i)  is  easily  proven  by  reference  to 

Equation  (2)  with  k  •  1.  Thus, 

f(n)  *  f(n-l)  +  f(i)  +  i. 

•  *  , »  , 

Next,,  we  prove  by  induction  on  n  that 
f(n)  i  (n/2)  log2  n 


,  >) 


‘ 


L  J 


113. 


We  have  for  n=l 


f(l)  =  (l/2)log2l  =  0.  In  general. 


f(n>  -Jhfli  (f(k)  -  f(n-k> +  '•} 

i  Max  /  \ 

Uk*[n/2]  Wk/2)  log2k  +  ((n-k)/2)  log2  (n-k)  +  kj 

“  wa^r  ,  ,  ](x/2>  1o<32x  +  ( (n-x)/2 )  log?  (n-x)  +  x\ 

lix  si[n/2]  v  *  2  ) 

■  (n/2)  log2  n, 

where  the  first  inequality  results  from  the  induction  hypothesis, 
the  second  is  a  consequence  of  simply  allowing  more  points  to  be 
considered  in  the  maximization,  and  the  last  equality  results 
from  the  lemma.  Now  to  prove  (ii),  we  do  this  by  induction  on 
For  1  we  have  the  trivial  result  f (2)  «  1*2°  *  1  since  there 
are  only  two  nets  on  2  nodes .  In  general,  by  Equation  (3)  for  n  - 

V*2*  b  f(2*)  £  i£fc£2l-l  |f(k)  +  f (n-k)  +  kj- 

=  f(2f'1)  +  f'2i“1)  +  2<e“1 

,  / 

-  (f- D2*"2  +  (i-l)2*"2  +  2*"1 

.  i- 1 

=  f2  by  the  induction  hypothesis. 

This  establishes  (ii) .  (iii)  is  an  obvious  consequence  of  (i) 
and  (ii)  „ 

The  number  of  operations  can  be  reduced  still  further  using 
another  variant.  Algorithm  3,  of  Algorithm  1.  The  key  to 


Algorithm  3  is  the  use  of  a  tree  structure  to  maintain  the  number 
of  the  components  of  each  node.  Associated  with  each  node  i  is 
another  node.  f(i)»  the  father  of  i.  To  find  the  component  of  a 
node  i,  set  i0=  i  and  repeat  the  iterations 

ifcfl  =  f(ik>  (*L .. 

until 

i*  =  f(ik)  =  ik#  (**) 

Then,  i*  is  the  component  label.  Define  F(i)=i*to  be  the  patriarch 
of  i.  The  sequence  i,  i^,  ....  ik,  i*  will  be  called  the  chain 
determined  by  i.  Then  there  is  a  one  to  one  correspondence  between 
components  and  patriarchs.  Based  on  such  a  data  structure,  a  simple 
algorithm  for  determining  the  components  might  be: 

Algorithm  [Read:  1969] 

Step  Os.  (Initialization).  Set  f(i):«i,  i-1,  . . . ,  NN,  Aq  -  0, 
k:=0  and  go  to  Step  1. 

b  *  "«.•••  ' 

Step  Is  (New  link).  Add  a  link  ajc“tnk#  r.k)  to  Ak.  Form  Ak+1.  If 
there  are  no  remaining  links,  i.e.,  Ak  =  A,  Stop. 

Examine  Ffm^)  and  F(n^).  if  they  are  identical,  repeat 

Step  1  with  ks“  k+1.  if  not  go  to  Step  2. 

\ 

(Join  trees).  Set  f(F(nk))to  Ffm^.  Set  ksk+1.  go  to  Step  1. 


Step  2t 


Of  Algorithm,  The  major  computational  expense  occurs  in 
Step  1.  step  1  is  encountered  n  times  and  each  time  P,nJc,  and 
F(mk,  must  be  evaluated.  This  could  involve  examining  at  most 

k  "°deS  1  "k  and  "k  are  in  the  same  component  and  k  nodes  if  they 
are  in  different  components .  For  example,  if  the  net  is  a  chain 

and  the  links  are  introduced  in  order  then  k  nodes  would  he  examined 
for  each  k.  m  any  case,  the  order  of  the  calculation  is  NB  *NN 
so  this  algorithm  is  inferior  to  Algorithm  2.  However,  we  can 

improve  this  algorithm  so  that  it  takes  a  number  of  operations  ~~ 

proportional  to  NB  bv  uRinrr  " 

7  ing  the  information  gained  in  evaluating 

F  to  collapse  the  tree. 

Algorithm  3- 

Step  0,  Initialization).  Set  f  (i, ,  «  i  for  i  *  i . . 

As=  0  and  go  to  Step  1. 

Step  lj  (New  link).  Add  a  link  a  =,  x  „ 

lnK  ak“  <mk'  nk>  to  Ak  to  form  Ak+1> 

If  there  are  no  remaining  links,  i.e.,  Ak  .  A,  go  to 

step  2.  Set  ffih-FO^)  for  every  node  on  the  chains 
defined  by  mk  and  nk.  Set  k,  .  k+X  and  do  step  x  again_ 

Step  2,  (clean  up).  Set  f(i),-F(i)  for  i  .  1 . . 

Analysis  of  Algorithm  3. 

The  detailed  analysis  is  somewhat  tedious  and  can  be  found  in 
(Kershenbaum  &  Van  slyke,  1972].  The  principal  computational  expen.. 
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IS  in  collapsing  the  tree  and  computing  F(mk).  m  particular,  we 
must  essentially  travel  the  chain  from  mk  twice  or  save  the  chain 
because  we  cannot  relabel  the  chain  until  we  know  F(mk).  Nevertheless, 
the  total  number  of  operations  can  be  shown  to  be  of  the 
order  of  NB.  To.  obtain  intermediate  results  on  the  components 
one  keeps  the  current  number  of  components  and  associates  with  each 
patriarch  node  p  a  number  d(p)  which  represents  the  number  of  nodes  • 
"down"  the  component  tree  from  p  where  f (i)  is  "above"  i.  Then  in 
Step  1  if  F(mk)  ^  F(nfc)  then  two  trees  are  being  joined  so  the 
number  of  components  is  reduced  by  one  and  d (F (n^) ) -=  d(F(mk))  + 

d(F(r-k)).  Then  for  any  patriarch  p  the  number  of  elements  in  the 
corresponding  component  is  d(p). 

The  father  relations  established  by  Read's  algorithm  can  be 
thought  of  as  branches  of  a  tree,  T,  where  if  j  =  f(i),  then  j  is 
"above"  or  is  the  "predecessor"  of  i  in  T.  Initially,  no  branches 
of  T  are  present.  As  each  step  is  performed  a  branch  of  T  is 
"filled  in"  if  2  components  are  connected,  otherwise  nothing 
happens,  in  the  sample  tree  T  depicted  in  Figure  4.4.1  the  heavy 
lines  represent  the  branches  "filled  in"  so  far  at  some  stage  of 
the  algorithm.  A  step  in  which  the  link  (5,  8)  is  considered  ' 
would  cause  (2,7)  to  be  filled  in,  while  the  introduction  of  (5,6) 
would  leave  the  situation  unchanged.  In  Algorithm  3  we  initially 
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consider  the  same  T  as  in  Read's  Algorithm.  However,  the  structure 
of  T  may  be  altered  as  a  consequence  of  any  step  of  Algorithm  3. 

Thus,  suppose  the  tree  T  depicted  in  Figure  4.4.1  represents  the 
component  tree  at  some  point  during  the  application  of  Algorithm  3. 
Then  a  step  in  which  (5,8)  is  introduced  would  result  in  the  modi¬ 
fied  tree  T'of  Figure  4.4.2.  All  nodes  whose  fr.chers  are  examined 
in  the  course  of  determining  F(m^)  and  F(nk)  become  immediate 
successors  of  F(mk).  In  the  example,  these  are  nodes  5,  4,  2,  8,  7. 

Algorithm  3  while  being  somewhat  more  complicated  than 
Algorithm  1  has  the  virtue  that  links  can  be  introduced  in  arbitrary 
order  and  at  any  point  in  the  algorithm  the  subnet  is  completely 
analyzed,  in  particular,  for1  the  functional  simulation  method 
the  links  can  be  introduced  in  order  of  the  random  numbers  assigned 
to  the  links.  Moreover,  the  order  of  the  number  of  operations  is 
still  NB. 

A  final  algorithm  we  consider  is  Algorithm  4,  Prim's  Algorithm. 
[Prim* 1957],  [Dijkstra:  1959],  it  is  designed  to  find  a  maximum 
length  spanning  tree.  We  modify  this  algorithm  for  use  in  reliability 
analysis.  At  step  k  we  have  a  set  of  nodes  A^  and  we  consider  the 
links  with  one  incident  node  in  Ak  and  the  other  one  not  in  A*. 

If,  of  all  such  links,  (i,j)  is  the  longest  with  iCA^,  j  <  Ak 
we  then  let  Ak+^  ■  j  \j  Ak  and  iterate.  Stated  more  formally! 


Algorithm  4:  Let  dj  be  the  length  of  the  longest  link  from  Ak  to 
j  for  j  i  Ak. 

Step  0,  (Initialization).  Ax  =  {l},  k  =  1,  dx=  0,  dj  »  ^  ^  if 

d'j)  10  a  link'  dj  =  00  otherwise .where  r£  j  is  the  random  number 
assigned  to  link  (i,j). 

Step  1,  (increase  Ak) .  Let  d,.  d*  and  Ak+1  -  Ak  t»  [  j  J. 

Update  the  dj  by  d_.,=  Max  ^  dj ,  r  Go  to  Step  2. 

Step  2s  (Test  for  termination).  If  k  ■  NN,  stop;  otherwise  go 
to  Step  1. 

Algorithm  4  can  be  used  if  the  measure  of  network  reliability 
is  the  probability  of  the  network  being  connected,  if  one  saves 
the  smallest  dj*  encountered  in  Step  1,  (suppose  it  is  rk*)  then 
for  P  <  r*  the  net  is  connected  for  that  sample  point  and  for 
p£r*the  net  is  disconnected.  This  algorithm  restricts  the  order 
in  which  the  links  can  be  introduced  but  does  not  require  one  to 
present  the  links  in  order  of  decreasing  r±  j.  Step  1  is  performed 
NN-1  times  and  at  the  kth  step  2»NN-2k-l  comparisons  must  be  made 
to  determine  j*  and  to  update  the  dj.  Thus  about  NN(NN-l)  compari¬ 
sons  must  be  made  which  ^ives  an  order  of  computation  of  NN2  for 
this  algorithm.  < 


Evaluation  of  Algorithms  fnr  payability 

we  are  now  in  a  position  to  estimate  the  most  efficient 
techniques  for  large  network  reliability  problems.  In  order  to 

find  HP  values  of  h(p,  and  n  (p,  for  a  network  with  eh  nodes  and 

“  links,  we  require  the  following  amounts  of  computation.  for 

naive  method,  we  perform  on  the  order  of  HP.  MB  operations  for 

each  sample  point.  To  use  functional  simulation,  we  must  presort 

the  links  by  decreasing  values  of  their  random  numbers. 

Thin  computation, which  in  itself  requires  on  th.  a  a 

requ.res  on  the  order  of  NB  log  NB 

comparisons  dominates  the  order  of  captation  for  Algorithm  3  whig. 

10  eSSenUaUy  U"ear  in  “•  «  reliability  is  measured  by  the 

probability  of  disconnection.  Algorithm  4  can  be  used  to  avoid 
the  ordering.  The  order  of  calculation,  in  this  case  is  HN2. 

MOOre'Shann°n  appr0ach  ~  *»  directly  cospared  because 
the  statistical  analysis  is  different.  However.  Algorithm  1  or 

Algorithm  3  could  be  used  effectively  by  generating  a  random 

ordering  of  the  links  and  then  introducing  them  one  at  a  time  to 

obtain  a  sample  point  for  c(l),  then  C(2> . 8t=.  This  is 

another  means  of  avoiding  the  sorting  of  random  numbers  associated 
with  links. 

limiting  ourselves  to  the  naive  method  and  the  functional  ' 
simulation  method,  we  see  that  for  HP  small,  „aiv.  simulation  is 
preferable  because  it  avoid,  sorting  the  links.  Per  HP  large 
function  simulation  is  preferable  using  Algorithm  3  exc.pt  that 
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tor  early  complete  networks  usincr  th„ 

using  the  connectivity  criterion 

..."  W  .«.«  w  ___  ^ 

^  ““  — ~ ...  »> 

required  for  Prim's  algorithm. 

*.  exact  Points  at  which  these  tradeoffs  occur  depend  on 
aractenstic.  of  the  computer  and  the  coding  used  to  implement 

^  — 1  —  «  presently  in  progress 
and  the  result,  will  he  reported  at  a  later  date. 
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